00000001:02000400:3.0F:1789120577.196374:0:2968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789120596.238593:0:3194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789120598.223630:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 659 MB/s 00000001:01000000:1.0F:1789120598.473756:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 635 MB/s 00000001:01000000:3.0:1789120598.723512:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2975 MB/s 00000020:02000000:3.0:1789120599.266945:0:3286:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_139_gd84534a 00000400:02000000:0.0F:1789120600.171653:0:3301:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.109@tcp [8/256/0/180] 00008000:02000000:0.0:1789120603.435934:0:3451:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789120642.618886:0:5256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789120650.416779:0:5838:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789120650.416784:0:5838:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789120650.416894:0:5838:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bd51dc82 00000080:02000400:1.0:1789120650.416972:0:5838:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789120650.421611:0:5838:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789120650.421623:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789120650.421717:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b188fcb2) 00000020:00000080:2.0:1789120650.421736:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789120650.436238:0:5838:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789120650.436700:0:5838:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789120650.456353:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789120650.456391:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789120650.456489:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789120650.456538:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789120650.456563:0:5838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789120650.456888:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789120650.456966:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789120650.456978:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4a13 00000020:01000004:3.0:1789120650.456984:0:5838:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789120650.456989:0:5838:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789120650.456993:0:5838:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd51dc82 from MGS 00000020:01000004:3.0:1789120650.456997:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789120650.457014:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008bad3e52) 00000020:00000080:3.0:1789120650.457024:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789120650.457116:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd51dc82 from MGS, refs=2 00080000:01000000:3.0:1789120650.457121:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789120650.457126:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4a21 00000100:00100000:3.0:1789120650.457298:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789120650.457441:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789120650.457447:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789120650.457970:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789120650.457978:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789120650.458610:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120650.458756:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789120650.458762:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789120650.459759:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789120650.459768:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789120650.460307:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789120650.460320:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789120650.461066:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120650.461071:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120650.461073:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120650.461370:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120650.461372:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120650.461373:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120650.462316:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789120650.467495:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789120650.712602:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3247 MB/s 00000001:01000000:0.0:1789120650.962297:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3599 MB/s 00000001:01000000:2.0:1789120651.212775:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 543 MB/s 00000001:01000000:2.0:1789120651.462194:0:5838:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 995 MB/s 00080000:10000000:2.0:1789120651.468984:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789120651.481443:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789120651.481461:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789120651.481464:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789120651.482218:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789120651.482453:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789120651.482498:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789120651.482731:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789120651.482759:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789120651.483211:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120651.483505:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789120651.483513:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789120651.485876:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789120651.485887:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789120651.486507:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789120651.486514:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789120651.487008:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789120651.487027:0:5838:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.109@tcp' 00000020:01000004:0.0:1789120651.487029:0:5838:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789120651.487077:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.109@tcp (typ=mgc) 00000020:00000080:0.0:1789120651.487425:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.109@tcp (000000005ac19952) 00000020:00000080:0.0:1789120651.487443:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1789120651.487489:0:5853:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1789120651.487570:0:5838:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004a8b9e01@MGC192.168.206.109@tcp: add connection 192.168.206.109@tcp at head 00010000:00010000:0.0:1789120651.487721:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.109@tcp-0 is initialized 00000040:01000000:0.0:1789120651.487727:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789120651.489803:0:5854:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789120651.489903:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.109@tcp (uuid 71bf207b-8b16-4d55-83e2-f8c047f616c0) 00000020:00000080:0.0:1789120651.489927:0:5838:0:(genops.c:1385:class_connect()) connect: client 71bf207b-8b16-4d55-83e2-f8c047f616c0, cookie 0x13cfa3d77faa4a2f 00000100:00080000:0.0:1789120651.489937:0:5838:0:(import.c:510:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120651.489944:0:5838:0:(import.c:624:import_select_connection()) MGC192.168.206.109@tcp: import 000000004a8b9e01 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789120651.489970:0:5838:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000023fc0c9a x1876028922265728/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789120651.490055:0:5838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS 00000020:01000004:0.0:1789120651.490081:0:5838:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789120651.490086:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789120651.490098:0:5838:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bcdf29df) 00000020:00000080:0.0:1789120651.490193:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789120651.490248:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023fc0c9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922265728:0@lo:250: 00000100:00100000:3.0:1789120651.490333:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120651.490422:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922265728 00000100:00100000:3.0:1789120651.490437:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922265728 00000100:00100000:3.0:1789120651.490468:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120651.490475:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000575775e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1876028922265728:12345-0@lo:250: 00010000:00080000:3.0:1789120651.490514:0:5850:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 71bf207b-8b16-4d55-83e2-f8c047f616c0@0@lo t0 exp 0000000000000000 cur 118 last 0 00000020:00000080:3.0:1789120651.490538:0:5850:0:(genops.c:1385:class_connect()) connect: client 71bf207b-8b16-4d55-83e2-f8c047f616c0, cookie 0x13cfa3d77faa4a3d 00000100:00080000:3.0:1789120651.490729:0:5850:0:(import.c:65:import_set_state_nolock()) 0000000030d02274 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120651.490788:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000575775e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:3316:x1876028922265728:12345-0@lo:250: Request processed in 312us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120651.490796:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120651.490859:0:3316:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789120651.490869:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.109@tcp: connect to target with instance 0 00000100:00080000:3.0:1789120651.490877:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789120651.490880:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789120651.490883:0:3316:0:(import.c:65:import_set_state_nolock()) 000000004a8b9e01 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789120651.490887:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789120651.490894:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789120651.490900:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023fc0c9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922265728:0@lo:250: 00000100:00100000:0.0:1789120651.498270:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00010000:00010000:0.0:1789120651.498325:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120651.498555:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789120651.498564:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789120651.500194:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789120651.500206:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789120651.503533:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789120651.503544:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789120651.504505:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789120651.504689:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789120651.504696:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789120651.506783:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789120651.506799:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789120651.556441:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789120651.557443:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789120651.557449:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789120651.558459:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789120651.558469:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789120651.559771:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789120651.559954:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789120651.559960:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789120651.560494:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789120651.560501:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789120651.560997:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789120651.561134:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789120651.561139:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789120651.561672:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789120651.561680:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789120651.562215:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120651.562384:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789120651.562390:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789120651.562904:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789120651.562916:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789120651.583248:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120651.583609:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789120651.583616:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789120651.585829:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789120651.585842:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789120651.587374:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789120651.587387:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789120651.589863:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789120651.589889:0:5838:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789120651.589896:0:5838:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789120651.590035:0:5838:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789120651.590072:0:5838:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789120651.590076:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789120651.590077:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120651.590079:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120651.590080:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120651.590081:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120651.590086:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120651.590088:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120651.590089:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120651.590090:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120651.590091:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120651.590093:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120651.590094:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120651.590097:0:5838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789120651.590099:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120651.590100:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120651.590101:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120651.590102:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120651.590103:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120651.590104:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120651.590105:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120651.590105:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120651.590106:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120651.590107:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120651.590108:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120651.590109:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120651.590133:0:5838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789120651.590241:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c02daef pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922265856:0@lo:253: 00000100:00100000:0.0:1789120651.590328:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.590656:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000003df11384 going to sleep for 11 seconds 00000100:00100000:3.0:1789120651.590736:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922265856 00000100:00100000:3.0:1789120651.590744:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922265856 00000100:00100000:3.0:1789120651.590823:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120651.590832:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a120b815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:5838:x1876028922265856:12345-0@lo:253: 20000000:01000000:3.0:1789120651.590887:0:5852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789120651.590890:0:5852:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789120651.591237:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789120651.591311:0:5852:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789120651.591754:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120651.592890:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789120651.593127:0:5852:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789120651.593131:0:5852:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789120651.593137:0:5852:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789120651.593140:0:5852:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789120651.594580:0:5852:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789120651.594811:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120651.595038:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789120651.595051:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789120651.595100:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789120651.595481:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789120651.595524:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789120651.595619:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789120651.595628:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789120651.595691:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789120651.595701:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789120651.595736:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789120651.595750:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789120651.595784:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789120651.595836:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789120651.595877:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789120651.595882:0:5852:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789120651.595894:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120651.596070:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789120651.596081:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789120651.596118:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789120651.596493:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789120651.596548:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789120651.596560:0:5852:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789120651.596637:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789120651.596645:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789120651.596687:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789120651.596718:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789120651.596772:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789120651.596784:0:5852:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789120651.596896:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789120651.596905:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789120651.596936:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789120651.596970:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789120651.597523:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789120651.597575:0:5852:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789120651.597582:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789120651.598122:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789120651.598606:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789120651.598628:0:5852:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.109@tcp for mdt 20000000:01000000:1.0:1789120651.598631:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:1.0:1789120651.598666:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789120651.598674:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789120651.598708:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789120651.598716:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:1.0:1789120651.598776:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789120651.598787:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789120651.598821:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789120651.598873:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789120651.598930:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789120651.598933:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789120651.598937:0:5852:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789120651.598962:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789120651.598964:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789120651.598993:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789120651.598995:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789120651.599698:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789120651.599939:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789120651.599982:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789120651.600045:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789120651.600058:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789120651.600060:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789120651.600699:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789120651.600939:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789120651.600980:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789120651.601016:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789120651.601029:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120651.601032:0:5852:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789120651.601036:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789120651.601038:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789120651.601042:0:5852:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789120651.601047:0:5852:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789120651.601617:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789120651.601735:0:5852:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789120651.610014:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789120651.610097:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789120651.610241:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789120651.610265:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789120651.610287:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610303:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610314:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610320:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610327:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610469:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610475:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028e77bf3 already unused, calling callback (000000009fbe715f) 00010000:00010000:2.0:1789120651.610479:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610487:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610500:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610519:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120651.610524:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028e77bf3/0x13cfa3d77faa4a44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789120651.610539:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789120651.767000:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a120b815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:5838:x1876028922265856:12345-0@lo:253: Request processed in 176163us (176665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120651.767018:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120651.767123:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c02daef pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922265856:0@lo:253: 10000000:01000000:1.0:1789120651.767139:0:5838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789120651.767161:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120651.767179:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789120651.767180:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120651.767181:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789120651.767183:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120651.767184:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120651.767185:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789120651.767187:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789120651.767188:0:5838:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789120651.767190:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120651.767191:0:5838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789120651.767211:0:5838:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bd51dc82 from lustre-MDT0000 10000000:01000000:1.0:1789120651.767245:0:5838:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789120651.767248:0:5838:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789120651.767252:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ffd9cd18000 10000000:01000000:1.0:1789120651.767256:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789120651.767263:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffd9cd18000 from 1 10000000:01000000:1.0:1789120651.767267:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789120651.767305:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.767314:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.767322:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120651.767340:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922265984:0@lo:101: 00000100:00100000:1.0:1789120651.767376:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.767522:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:2.0:1789120651.767672:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922265984 00000100:00100000:2.0:1789120651.767678:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922265984 00000100:00100000:0.0:1789120651.767814:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120651.767824:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f2dbac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:5838:x1876028922265984:12345-0@lo:101: 00010000:00010000:0.0:1789120651.767837:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120651.767860:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069fb5824/0x13cfa3d77faa4a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4a4b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.767880:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069fb5824/0x13cfa3d77faa4a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.767957:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069fb5824/0x13cfa3d77faa4a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.767966:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069fb5824, rc 0) 00000100:00100000:0.0:1789120651.768047:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f2dbac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:5838:x1876028922265984:12345-0@lo:101: Request processed in 225us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120651.768054:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120651.768115:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922265984:0@lo:101: 00010000:00010000:1.0:1789120651.768129:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.768212:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120651.768262:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266112:0@lo:501: 00000100:00100000:1.0:1789120651.768290:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.768353:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789120651.768390:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266112 00000100:00100000:0.0:1789120651.768395:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266112 00000100:00100000:0.0:1789120651.768494:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120651.768501:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006341c3f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:5838:x1876028922266112:12345-0@lo:501: 00000100:00100000:0.0:1789120651.768745:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006341c3f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:5838:x1876028922266112:12345-0@lo:501: Request processed in 246us (455us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120651.768753:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120651.768858:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266112:0@lo:501: 10000000:01000000:1.0:1789120651.768882:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789120651.768986:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.768994:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 000000007582e977/0x13cfa3d77faa4a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120651.769002:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffd85287800 10000000:01000000:1.0:1789120651.769007:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789120651.769010:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ffd85287800 10000000:01000000:1.0:1789120651.769012:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789120651.769015:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ffd85287800 from 1 10000000:01000000:1.0:1789120651.769018:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789120651.769035:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769041:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769048:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120651.769074:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266240:0@lo:101: 00000100:00100000:1.0:1789120651.769102:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.769181:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789120651.769256:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266240 00000100:00100000:0.0:1789120651.769260:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266240 00000100:00100000:0.0:1789120651.769288:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120651.769295:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cd5ccdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:5838:x1876028922266240:12345-0@lo:101: 00010000:00010000:0.0:1789120651.769303:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120651.769313:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c36ffd4/0x13cfa3d77faa4a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4a59 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769328:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c36ffd4/0x13cfa3d77faa4a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a59 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769335:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c36ffd4/0x13cfa3d77faa4a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a59 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769352:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c36ffd4, rc 0) 00000100:00100000:0.0:1789120651.769480:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cd5ccdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+7:5838:x1876028922266240:12345-0@lo:101: Request processed in 185us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120651.769487:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120651.769529:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266240:0@lo:101: 00010000:00010000:1.0:1789120651.769540:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769547:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120651.769558:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789120651.769597:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769603:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 00000000326d47c7/0x13cfa3d77faa4a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120651.769608:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789120651.769610:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789120651.769614:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ffd85287800 10000000:01000000:1.0:1789120651.769615:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789120651.769617:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789120651.769619:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120651.769630:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769634:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.769648:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120651.769657:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266368:0@lo:101: 00000100:00100000:1.0:1789120651.769679:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.769696:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789120651.769745:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266368 00000100:00100000:0.0:1789120651.769749:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266368 00000100:00100000:0.0:1789120651.769777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120651.769782:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d16033d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+7:5838:x1876028922266368:12345-0@lo:101: 00010000:00010000:0.0:1789120651.769788:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120651.769795:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dba372e2/0x13cfa3d77faa4a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4a67 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769807:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dba372e2/0x13cfa3d77faa4a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769813:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dba372e2/0x13cfa3d77faa4a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120651.769819:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dba372e2, rc 0) 00000100:00100000:0.0:1789120651.769862:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d16033d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+8:5838:x1876028922266368:12345-0@lo:101: Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120651.769868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120651.770026:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266368:0@lo:101: 00010000:00010000:1.0:1789120651.770035:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120651.770042:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120651.770079:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266496:0@lo:501: 00000100:00100000:1.0:1789120651.770102:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.770120:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:0.0:1789120651.770194:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266496 00000100:00100000:0.0:1789120651.770198:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266496 00000100:00100000:0.0:1789120651.770224:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120651.770230:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7ed47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+8:5838:x1876028922266496:12345-0@lo:501: 00000100:00100000:1.0:1789120651.770494:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266496:0@lo:501: 00000100:00100000:1.0:1789120651.770522:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266624:0@lo:503: 00000100:00100000:1.0:1789120651.770558:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.770592:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f1b30 going to sleep for 11 seconds 00000100:00100000:2.0:1789120651.770599:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266624 00000100:00100000:2.0:1789120651.770603:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266624 00000100:00100000:2.0:1789120651.770627:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120651.770627:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7ed47a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922266496:12345-0@lo:501: Request processed in 398us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120651.770632:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c2e20a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922266624:12345-0@lo:503: 00000100:00100000:0.0:1789120651.770639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789120651.770784:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c2e20a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5838:x1876028922266624:12345-0@lo:503: Request processed in 152us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120651.770791:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120651.770876:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922266624:0@lo:503: 00000100:00100000:1.0:1789120651.771273:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5880:1876028922266752:0@lo:502: 00000100:00100000:1.0:1789120651.771309:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120651.771389:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b8b00ee going to sleep for 11 seconds 00000100:00100000:0.0:1789120651.771425:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266752 00000100:00100000:0.0:1789120651.771430:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266752 00000100:00100000:0.0:1789120651.771504:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120651.771511:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f2ebff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5880:x1876028922266752:12345-0@lo:502: 00000100:00100000:0.0:1789120651.771830:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f2ebff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5880:x1876028922266752:12345-0@lo:502: Request processed in 319us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120651.771838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789120651.771863:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5880:1876028922266752:0@lo:502: 00000020:01000000:1.0:1789120651.771890:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120651.771899:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120651.771901:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789120651.771905:0:5880:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789120651.771908:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789120651.771931:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f8536777) 00000020:00000080:1.0:1789120651.771947:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789120651.771953:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789120651.772063:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789120651.772069:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4a7c 00000020:00000080:1.0:1789120651.772381:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789120651.772387:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120651.772391:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120651.772392:0:5880:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789120651.772394:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120651.772708:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120651.772710:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789120651.772715:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789120651.772722:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ad2f57ff) 00000020:00000080:1.0:1789120651.772801:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789120651.772808:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789120651.772810:0:5880:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789120651.772812:0:5880:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789120651.772818:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789120651.772890:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd51dc82 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789120651.772977:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000096bef66) 00000020:00000080:1.0:1789120651.772986:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789120651.773037:0:5880:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789120651.773043:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa4a91 00000020:00000080:1.0:1789120651.773223:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789120651.773230:0:5880:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789120651.773234:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x13cfa3d77faa4a98 00080000:01000000:1.0:1789120651.773239:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789120651.773248:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4a9f 00080000:10000000:1.0:1789120651.773681:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789120651.774037:0:5880:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789120651.779226:0:5880:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789120651.839495:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789120651.839999:0:5880:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789120651.843210:0:5880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789120651.843489:0:5880:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789120651.878495:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c12d8d23) 00000020:00000080:0.0:1789120651.878530:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789120651.878627:0:5880:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789120651.878634:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4aad 00000020:00000080:2.0:1789120651.886581:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789120651.888586:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120651.920819:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120651.955402:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120651.993928:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120652.033356:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120652.070331:0:5880:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789120652.121041:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x13cfa3d77faa4ab4 00000020:00000080:3.0:1789120652.121584:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789120652.121595:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120652.121601:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120652.121603:0:5880:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789120652.121605:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120652.121609:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120652.121610:0:5880:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789120652.121612:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789120652.121614:0:5880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789120652.121616:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120652.121618:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120652.121619:0:5880:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789120652.121621:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120652.121625:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120652.121626:0:5880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789120652.121630:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789120652.121669:0:5880:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789120652.121725:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071d81dfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5880:1876028922266880:0@lo:502: 00000100:00100000:3.0:1789120652.121804:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120652.121880:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005bdfd4e going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.121969:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922266880 00000100:00100000:0.0:1789120652.121977:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922266880 00000100:00100000:0.0:1789120652.122022:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120652.122031:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020b56a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5880:x1876028922266880:12345-0@lo:502: 00000100:00100000:0.0:1789120652.122328:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020b56a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5880:x1876028922266880:12345-0@lo:502: Request processed in 299us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.122335:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120652.122525:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071d81dfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5880:1876028922266880:0@lo:502: 00000020:01000000:3.0:1789120652.122554:0:5880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120652.122563:0:5880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120652.122565:0:5880:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789120652.122568:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789120652.122707:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789120652.122727:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789120652.122745:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.122755:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 00000000cb4cfa1e/0x13cfa3d77faa4a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120652.122763:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd85287800 from 1 10000000:01000000:1.0:1789120652.122766:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120652.122792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.122799:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.122808:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120652.122821:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267008:0@lo:101: 00000100:00100000:1.0:1789120652.122863:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.122891:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000723f8899 going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.123275:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267008 00000100:00100000:0.0:1789120652.123281:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267008 00000100:00100000:0.0:1789120652.123316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120652.123323:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c39dbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:5838:x1876028922267008:12345-0@lo:101: 00010000:00010000:0.0:1789120652.123334:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120652.123345:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4abb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.123477:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.123487:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.123495:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040d24e28, rc 0) 00000100:00100000:0.0:1789120652.123537:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c39dbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922267008:12345-0@lo:101: Request processed in 215us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.123544:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120652.123629:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267008:0@lo:101: 00010000:00010000:1.0:1789120652.123643:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.123662:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120652.124269:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267136:0@lo:256: 00000100:00100000:1.0:1789120652.124314:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.124487:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000723f8899 going to sleep for 11 seconds 00000100:00100000:2.0:1789120652.125701:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267136 00000100:00100000:2.0:1789120652.125711:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267136 00000100:00100000:2.0:1789120652.125814:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120652.125822:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d7cf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922267136:12345-0@lo:256: 20000000:01000000:2.0:1789120652.125854:0:5852:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789120652.125871:0:5852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789120652.125977:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d7cf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922267136:12345-0@lo:256: Request processed in 156us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120652.125985:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120652.126083:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267136:0@lo:256: 10000000:01000000:1.0:1789120652.126681:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789120652.126699:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.126710:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120652.126718:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 1 10000000:01000000:1.0:1789120652.126722:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120652.126752:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.126759:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.126767:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120652.126784:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267264:0@lo:101: 00000100:00100000:1.0:1789120652.126824:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.127223:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000723f8899 going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.127341:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267264 00000100:00100000:0.0:1789120652.127347:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267264 00000100:00100000:0.0:1789120652.127438:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789120652.127446:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fba358cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5838:x1876028922267264:12345-0@lo:101: 00010000:00010000:0.0:1789120652.127458:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120652.127471:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4ac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.127492:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.127501:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.127510:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a49f9e4, rc 0) 00000100:00100000:0.0:1789120652.127554:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fba358cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267264:12345-0@lo:101: Request processed in 110us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.127561:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120652.127649:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267264:0@lo:101: 00010000:00010000:1.0:1789120652.127661:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.127669:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120652.127721:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267392:0@lo:501: 00000100:00100000:1.0:1789120652.127749:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.127778:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000723f8899 going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.127829:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267392 00000100:00100000:0.0:1789120652.127833:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267392 00000100:00100000:0.0:1789120652.127861:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120652.127867:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000406f35ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267392:12345-0@lo:501: 00000100:00100000:0.0:1789120652.128604:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000406f35ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267392:12345-0@lo:501: Request processed in 737us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.128614:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120652.128777:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267392:0@lo:501: 00000100:00100000:2.0:1789120652.128814:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000830b0744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267520:0@lo:503: 00000100:00100000:2.0:1789120652.128867:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120652.128911:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000007abef4fe going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.129141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267520 00000100:00100000:0.0:1789120652.129165:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267520 00000100:00100000:0.0:1789120652.129205:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789120652.129213:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070693d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267520:12345-0@lo:503: 00000040:00080000:0.0:1789120652.129251:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789120652.129289:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070693d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267520:12345-0@lo:503: Request processed in 77us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.129296:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120652.129444:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000830b0744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267520:0@lo:503: 00000040:00080000:1.0:1789120652.130808:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789120652.131098:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789120652.131116:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120652.131274:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120652.131287:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120652.131330:0:5838:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789120652.131332:0:5838:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffd85287800 10000000:01000000:2.0:1789120652.131335:0:5838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffd85287800 10000000:01000000:2.0:1789120652.131339:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120652.131345:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd85287800 from 1 10000000:01000000:2.0:1789120652.131348:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120652.131389:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120652.131397:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120652.131420:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120652.131438:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000830b0744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267648:0@lo:101: 00000100:00100000:2.0:1789120652.131489:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120652.131528:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e739734 going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.131639:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267648 00000100:00100000:0.0:1789120652.131647:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267648 00000100:00100000:0.0:1789120652.131687:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120652.131696:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001db109c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922267648:12345-0@lo:101: 00010000:00010000:0.0:1789120652.131708:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120652.131719:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2f16a2f/0x13cfa3d77faa4ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4ad7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.131741:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2f16a2f/0x13cfa3d77faa4ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.131749:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2f16a2f/0x13cfa3d77faa4ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.131769:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2f16a2f, rc 0) 00000100:00100000:0.0:1789120652.131817:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001db109c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922267648:12345-0@lo:101: Request processed in 123us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.131824:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789120652.131903:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000830b0744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267648:0@lo:101: 00010000:00010000:1.0:1789120652.131919:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.131927:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120652.131978:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267776:0@lo:501: 00000100:00100000:1.0:1789120652.132005:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.132027:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b692487f going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.132069:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267776 00000100:00100000:0.0:1789120652.132074:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267776 00000100:00100000:0.0:1789120652.132104:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120652.132110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e503201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922267776:12345-0@lo:501: 00000100:00100000:0.0:1789120652.132349:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e503201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922267776:12345-0@lo:501: Request processed in 239us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.132356:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789120652.132498:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267776:0@lo:501: 00000100:00100000:1.0:1789120652.132529:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267904:0@lo:503: 00000100:00100000:1.0:1789120652.132566:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.132589:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b692487f going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.132630:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922267904 00000100:00100000:0.0:1789120652.132635:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922267904 00000100:00100000:0.0:1789120652.132664:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120652.132671:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006c9e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922267904:12345-0@lo:503: 00000100:00100000:0.0:1789120652.132960:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006c9e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922267904:12345-0@lo:503: Request processed in 290us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.132967:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789120652.133039:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922267904:0@lo:503: 00000100:00100000:1.0:1789120652.133565:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5885:1876028922268032:0@lo:502: 00000100:00100000:1.0:1789120652.133604:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120652.133639:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bda5670e going to sleep for 11 seconds 00000100:00100000:0.0:1789120652.133679:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268032 00000100:00100000:0.0:1789120652.133684:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268032 00000100:00100000:0.0:1789120652.133713:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120652.133719:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ff32ef5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5885:x1876028922268032:12345-0@lo:502: 00000100:00100000:0.0:1789120652.133923:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ff32ef5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5885:x1876028922268032:12345-0@lo:502: Request processed in 203us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.133930:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120652.134001:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7679e3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5885:1876028922268032:0@lo:502: 00000020:01000004:2.0:1789120652.134049:0:5885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789120652.134060:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000073e710ea) 00000020:00000080:2.0:1789120652.134075:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789120652.134139:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bd51dc82 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789120652.134179:0:5885:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bd51dc82 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789120652.134182:0:5885:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bd51dc82 4 00010000:00080000:2.0:1789120652.134209:0:5885:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a2014cae@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789120652.136019:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789120652.136298:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789120652.136465:0:5885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789120652.136476:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x13cfa3d77faa4aec 00000100:00080000:2.0:1789120652.136486:0:5885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120652.136491:0:5885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a2014cae using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120652.136524:0:5885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000347316a1 x1876028922268160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120652.136550:0:5885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789120652.136924:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000347316a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922268160:0@lo:38: 00000100:00100000:1.0:1789120652.136990:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120652.137090:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268160 00000100:00100000:2.0:1789120652.137097:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268160 00000100:00100000:2.0:1789120652.137131:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120652.137137:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b0cbef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922268160:12345-0@lo:38: 00000100:00100000:2.0:1789120652.137313:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b0cbef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922268160:12345-0@lo:38: Request processed in 174us (322us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789120652.137320:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120652.137399:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120652.137406:0:3316:0:(import.c:65:import_set_state_nolock()) 00000000a2014cae lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789120652.137411:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789120652.137414:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000347316a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922268160:0@lo:38: 00000100:00100000:2.0:1789120652.138529:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039e97a01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5885:1876028922268288:0@lo:502: 00000100:00100000:2.0:1789120652.138594:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120652.139491:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a087e770 going to sleep for 11 seconds 00000100:00100000:3.0:1789120652.140277:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268288 00000100:00100000:3.0:1789120652.140288:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268288 00000100:00100000:3.0:1789120652.140344:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120652.140352:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009ddf849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5885:x1876028922268288:12345-0@lo:502: 00000100:00100000:3.0:1789120652.140734:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009ddf849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5885:x1876028922268288:12345-0@lo:502: Request processed in 382us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120652.140743:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120652.144000:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039e97a01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:5885:1876028922268288:0@lo:502: 00000040:00080000:1.0:1789120652.144062:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789120652.144249:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789120652.144279:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120652.144303:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.144313:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 0000000039bca5fb/0x13cfa3d77faa4ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789120652.144360:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789120652.144362:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120652.144364:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120652.144365:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120652.144366:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120652.144375:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120652.144376:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120652.144378:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120652.144380:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120652.144381:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120652.144383:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120652.144384:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120652.144388:0:5838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789120652.144390:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120652.144392:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120652.144393:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120652.144394:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120652.144395:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120652.144396:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120652.144397:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120652.144398:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120652.144399:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120652.144400:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120652.144401:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120652.144402:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120652.144423:0:5838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789120652.144438:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a02fb16b pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922268416:0@lo:253: 00000100:00100000:0.0:1789120652.144508:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120652.144546:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268416 00000100:00100000:0.0:1789120652.144552:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268416 00000100:00100000:0.0:1789120652.144597:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789120652.144605:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f005a7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5838:x1876028922268416:12345-0@lo:253: 20000000:01000000:0.0:1789120652.144630:0:5852:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789120652.144643:0:5852:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789120652.145542:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048f8a69d going to sleep for 11 seconds 20000000:01000000:3.0:1789120652.176359:0:5852:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789120652.176377:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789120652.176410:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789120652.176415:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789120652.176446:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120652.176463:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120652.176472:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120652.176507:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120652.176521:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 12 pid: 5850 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120652.176535:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071d81dfe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922268544:0@lo:104: 00000100:00100000:3.0:1789120652.176593:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120652.176679:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d3dfd79 going to sleep for 11 seconds 00000100:00100000:1.0:1789120652.177004:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268544 00000100:00100000:1.0:1789120652.177012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268544 00000100:00100000:1.0:1789120652.177062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120652.177070:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006095ae0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922268544:12345-0@lo:104: 00010000:00010000:1.0:1789120652.177082:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120652.177133:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120652.177138:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006095ae0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922268544:12345-0@lo:104: Request processed in 69us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120652.177173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120652.177258:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071d81dfe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922268544:0@lo:104: 00010000:00010000:0.0:1789120652.177277:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120652.177281:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.177284:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.177301:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006972ba33 already unused, calling callback (00000000ed90559e) 10000000:00010000:0.0:1789120652.177304:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.177313:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120652.177319:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120652.177325:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120652.177363:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.177370:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120652.177390:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120652.177458:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120652.177468:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000115c81d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922268672:0@lo:103: 00000100:00100000:3.0:1789120652.177502:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120652.177863:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: 000000006972ba33/0x13cfa3d77faa4abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.177882:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120652.177892:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120652.177894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120652.177941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268672 00000100:00100000:0.0:1789120652.177946:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268672 00010000:00010000:0.0:1789120652.177963:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 13 pid: 5850 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120652.178029:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120652.178036:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071d81dfe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3317:x1876028922268672:12345-0@lo:103: 00010000:00010000:0.0:1789120652.178047:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120652.178052:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 13 pid: 5850 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178064:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 13 pid: 5850 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178078:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040d24e28/0x13cfa3d77faa4ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4abb expref: 13 pid: 5850 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178091:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178099:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789120652.178112:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001697612s 00010000:00010000:0.0:1789120652.178116:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178124:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178140:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178172:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178178:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaf2f91f already unused, calling callback (000000009fbe715f) 00010000:00010000:0.0:1789120652.178182:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178209:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.178220:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120652.178352:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071d81dfe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:3317:x1876028922268672:12345-0@lo:103: Request processed in 317us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.178361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120652.178616:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000115c81d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922268672:0@lo:103: 00010000:00010000:0.0:1789120652.179560:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.179573:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120652.179578:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aaf2f91f/0x13cfa3d77faa4af3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120652.184731:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f005a7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5838:x1876028922268416:12345-0@lo:253: Request processed in 40121us (40217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120652.184761:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789120652.184868:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a02fb16b pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:5838:1876028922268416:0@lo:253: 10000000:01000000:1.0:1789120652.184884:0:5838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789120652.184888:0:5838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120652.184890:0:5838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789120652.184897:0:5838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120652.184898:0:5838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120652.184899:0:5838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120652.184901:0:5838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120652.184902:0:5838:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789120652.184903:0:5838:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789120652.184905:0:5838:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789120652.184906:0:5838:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789120652.184908:0:5838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120652.184910:0:5838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789120652.184925:0:5838:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789120652.191065:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.191557:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789120652.191784:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.191972:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789120652.192270:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.192599:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789120652.193655:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.193865:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789120652.194062:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.194331:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789120652.194692:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789120652.194895:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789120652.231813:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789120652.277864:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789120652.277872:0:5890:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789120652.277876:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789120652.278511:0:5891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789120652.286855:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789120652.287246:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789120652.287685:0:5838:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789120652.287692:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789120652.287971:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120652.289199:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789120652.290248:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789120652.290296:0:5838:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789120652.290675:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789120652.291115:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789120652.293324:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789120652.296243:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789120652.297000:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789120652.297378:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789120652.297595:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789120652.297837:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789120652.298000:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789120652.298276:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789120652.298627:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789120652.299015:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789120652.299207:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789120652.299540:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789120652.299789:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789120652.300019:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789120652.300215:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789120652.300604:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789120652.303822:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789120652.304481:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789120652.304733:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789120652.305034:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789120652.305367:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789120652.305525:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789120652.305760:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789120652.306266:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789120652.306449:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789120652.306697:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789120652.307409:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789120652.307762:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789120652.308322:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789120652.308438:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789120652.308722:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789120652.309046:0:5838:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789120652.309367:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789120652.328241:0:5891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789120652.374272:0:5838:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789120652.374309:0:5838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb0ac1cff988 00100000:10000000:2.0:1789120652.374317:0:5838:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789120652.376084:0:5838:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789120652.376102:0:5838:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789120652.376119:0:5838:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789120652.376182:0:5838:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789120652.421614:0:5891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789120652.421690:0:5891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789120652.421695:0:5891:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789120652.523319:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120653.546294:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120654.571824:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120655.595006:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120655.656991:0:6134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789120656.619628:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789120657.642651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789120657.642660:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789120657.642663:0:8:0:(import.c:65:import_set_state_nolock()) 00000000a2014cae lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789120657.642674:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a2014cae using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120657.642694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000016a3a79f x1876028922268928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120657.642888:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120657.642902:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033d1abad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922268800:0@lo:400: 00000100:00100000:3.0:1789120657.642972:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120657.643167:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268800 00000100:00100000:2.0:1789120657.643174:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268800 00000100:00100000:2.0:1789120657.643220:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789120657.643229:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000511c2553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3320:x1876028922268800:12345-0@lo:400: 00000100:00100000:2.0:1789120657.643289:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000511c2553 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3320:x1876028922268800:12345-0@lo:400: Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120657.643297:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789120657.643633:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033d1abad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922268800:0@lo:400: 00000100:00100000:1.0:1789120657.643787:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016a3a79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922268928:0@lo:38: 00000100:00100000:1.0:1789120657.643835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120657.643870:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120657.643931:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922268928 00000100:00100000:2.0:1789120657.643935:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922268928 00000100:00100000:2.0:1789120657.643963:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120657.643968:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002124b689 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876028922268928:12345-0@lo:38: 00010000:00080000:2.0:1789120657.643997:0:5859:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:2.0:1789120657.644028:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x13cfa3d77faa4afa 00000004:00100000:2.0:1789120657.644070:0:5859:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789120657.644205:0:5859:0:(import.c:65:import_set_state_nolock()) 0000000049bdf164 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120657.644257:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002124b689 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876028922268928:12345-0@lo:38: Request processed in 288us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120657.644264:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789120657.644447:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000016a3a79f x1876028922268928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789120657.644460:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789120657.644466:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789120657.644470:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120657.644472:0:3316:0:(import.c:65:import_set_state_nolock()) 00000000a2014cae lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120657.644476:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016a3a79f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922268928:0@lo:38: 00010000:00010000:0.0:1789120658.673585:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120659.694367:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789120659.767926:0:6336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf1ac2880 20000000:00000080:1.0:1789120659.767942:0:6336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdb57b0800 uarg=0000000000000000 20000000:01000000:1.0:1789120659.767974:0:6336:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789120659.767985:0:6336:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789120659.767989:0:6336:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789120659.768230:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789120659.768240:0:6336:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789120659.775993:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120659.776587:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789120659.776645:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789120659.776697:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789120659.776713:0:6336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789120659.776730:0:6336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.776746:0:6336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.776753:0:6336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.776790:0:6336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.776822:0:6336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 10 pid: 5851 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120659.777258:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2bb71eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1876028922269056:0@lo:104: 00000100:00100000:2.0:1789120659.778469:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120659.778527:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000510bf2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1789120659.779002:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269056 00000100:00100000:3.0:1789120659.779011:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269056 00000100:00100000:3.0:1789120659.779089:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120659.779097:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020633893 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:6336:x1876028922269056:12345-0@lo:104: 00010000:00010000:3.0:1789120659.779113:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.779212:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120659.779218:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020633893 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:6336:x1876028922269056:12345-0@lo:104: Request processed in 122us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120659.779225:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120659.779742:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2bb71eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1876028922269056:0@lo:104: 00010000:00010000:2.0:1789120659.779766:0:6336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.779962:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120659.779968:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.779976:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028be9d8e already unused, calling callback (00000000ed90559e) 10000000:00010000:3.0:1789120659.779979:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.779987:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120659.779993:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120659.779998:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120659.780069:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780076:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120659.780103:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780110:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: 0000000028be9d8e/0x13cfa3d77faa4ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ad0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780138:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120659.780140:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120659.780171:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120659.780210:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120659.780224:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922269184:0@lo:103: 00000100:00100000:2.0:1789120659.780270:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120659.780772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269184 00000100:00100000:3.0:1789120659.780779:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269184 00010000:00010000:3.0:1789120659.780812:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120659.780847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120659.780854:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2bb71eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3319:x1876028922269184:12345-0@lo:103: 00010000:00010000:3.0:1789120659.780865:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120659.780870:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780881:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780894:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a49f9e4/0x13cfa3d77faa4ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4ac9 expref: 11 pid: 5851 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780908:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780928:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780935:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780948:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780953:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780958:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000467fb97f already unused, calling callback (000000009fbe715f) 00010000:00010000:3.0:1789120659.780961:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780967:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780978:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120659.780987:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120659.781023:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2bb71eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:3319:x1876028922269184:12345-0@lo:103: Request processed in 170us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120659.781031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120659.781060:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922269184:0@lo:103: 00010000:00010000:2.0:1789120659.781127:0:6336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.781134:0:6336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120659.781139:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000467fb97f/0x13cfa3d77faa4b01 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120660.591245:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789120660.591252:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd85287800 from 3 10000000:01000000:3.0:1789120660.591257:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789120660.591295:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.591307:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.591470:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120660.591546:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269312:0@lo:101: 00000100:00100000:3.0:1789120660.591603:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120660.591679:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d76a3657 going to sleep for 11 seconds 00000100:00100000:0.0:1789120660.592455:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269312 00000100:00100000:0.0:1789120660.592464:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269312 00000100:00100000:0.0:1789120660.592511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120660.592520:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fabad73c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:5854:x1876028922269312:12345-0@lo:101: 00010000:00010000:0.0:1789120660.592535:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120660.593277:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022af7cf5/0x13cfa3d77faa4b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b08 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120660.593312:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022af7cf5/0x13cfa3d77faa4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120660.593323:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022af7cf5/0x13cfa3d77faa4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120660.593332:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022af7cf5, rc 0) 00000100:00100000:0.0:1789120660.593444:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fabad73c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5854:x1876028922269312:12345-0@lo:101: Request processed in 925us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120660.593451:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120660.593529:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269312:0@lo:101: 00010000:00010000:3.0:1789120660.593544:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.593552:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120660.593614:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269440:0@lo:256: 00000100:00100000:3.0:1789120660.593768:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120660.593869:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d76a3657 going to sleep for 11 seconds 00000100:00100000:0.0:1789120660.593909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269440 00000100:00100000:0.0:1789120660.593914:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269440 00000100:00100000:0.0:1789120660.594004:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120660.594013:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aece0fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5854:x1876028922269440:12345-0@lo:256: 20000000:01000000:0.0:1789120660.594028:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789120660.594041:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789120660.594045:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789120660.594879:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aece0fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5854:x1876028922269440:12345-0@lo:256: Request processed in 866us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120660.594889:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120660.598392:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269440:0@lo:256: 10000000:01000000:3.0:1789120660.598454:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789120660.598463:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.598474:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: 000000006fab4b68/0x13cfa3d77faa4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120660.598483:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120660.598486:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 1 10000000:01000000:3.0:1789120660.598488:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120660.598527:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: 0000000042be28c9/0x13cfa3d77faa4b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.598535:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: 0000000042be28c9/0x13cfa3d77faa4b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.598544:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: 0000000042be28c9/0x13cfa3d77faa4b16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120660.598563:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269568:0@lo:101: 00000100:00100000:3.0:1789120660.598619:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120660.598664:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269568 00000100:00100000:3.0:1789120660.598671:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d76a3657 going to sleep for 11 seconds 00000100:00100000:2.0:1789120660.598672:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269568 00000100:00100000:2.0:1789120660.598716:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120660.598723:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004edf5b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:5854:x1876028922269568:12345-0@lo:101: 00010000:00010000:2.0:1789120660.598736:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120660.598748:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea21c154/0x13cfa3d77faa4b1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b16 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120660.598788:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea21c154/0x13cfa3d77faa4b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120660.598808:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea21c154/0x13cfa3d77faa4b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120660.598817:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea21c154, rc 0) 00000100:00100000:2.0:1789120660.598856:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004edf5b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922269568:12345-0@lo:101: Request processed in 133us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120660.598862:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120660.598917:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269568:0@lo:101: 00010000:00010000:3.0:1789120660.598928:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: 0000000042be28c9/0x13cfa3d77faa4b16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.598937:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: 0000000042be28c9/0x13cfa3d77faa4b16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120660.598981:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269696:0@lo:501: 00000100:00100000:3.0:1789120660.599007:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120660.599030:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d76a3657 going to sleep for 11 seconds 00000100:00100000:2.0:1789120660.599329:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269696 00000100:00100000:2.0:1789120660.599334:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269696 00000100:00100000:2.0:1789120660.599371:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120660.599377:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071be85d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922269696:12345-0@lo:501: 00000100:00100000:2.0:1789120660.599614:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071be85d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922269696:12345-0@lo:501: Request processed in 237us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120660.599622:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120660.599653:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d9fabd96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269696:0@lo:501: 00000100:00100000:2.0:1789120660.599684:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724b0d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269824:0@lo:503: 00000100:00100000:2.0:1789120660.599721:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120660.599748:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f7b8bc33 going to sleep for 11 seconds 00000100:00100000:2.0:1789120660.599778:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269824 00000100:00100000:2.0:1789120660.599782:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269824 00000100:00100000:0.0:1789120660.599849:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120660.599858:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922269824:12345-0@lo:503: 00000100:00100000:0.0:1789120660.600028:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085a7dbbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922269824:12345-0@lo:503: Request processed in 172us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120660.600035:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789120660.600109:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724b0d15 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922269824:0@lo:503: 00000100:00100000:2.0:1789120660.600960:0:6360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000724b0d15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6360:1876028922269952:0@lo:502: 00000100:00100000:2.0:1789120660.601015:0:6360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120660.601042:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922269952 00000100:00100000:2.0:1789120660.601046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922269952 00000100:00100000:2.0:1789120660.601073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120660.601080:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017d7691a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6360:x1876028922269952:12345-0@lo:502: 00000100:00100000:2.0:1789120660.601738:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017d7691a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6360:x1876028922269952:12345-0@lo:502: Request processed in 657us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120660.601747:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120660.601811:0:6360:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e8708e3 going to sleep for 11 seconds 00000100:00100000:2.0:1789120660.601828:0:6360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000724b0d15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6360:1876028922269952:0@lo:502: 00000020:01000000:2.0:1789120660.601856:0:6360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120660.601865:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120660.601867:0:6360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789120660.601873:0:6360:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd85287800 00000020:00000080:2.0:1789120660.601876:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120660.601914:0:6360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6360:1876028922270080:0@lo:502: 00000100:00100000:2.0:1789120660.601953:0:6360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120660.601979:0:6360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5693180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120660.602112:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270080 00000100:00100000:3.0:1789120660.602118:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270080 00000100:00100000:3.0:1789120660.602175:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789120660.602183:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6360:x1876028922270080:12345-0@lo:502: 00000100:00100000:3.0:1789120660.602306:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6360:x1876028922270080:12345-0@lo:502: Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120660.602313:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120660.602768:0:6360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6360:1876028922270080:0@lo:502: 00000020:01000000:2.0:1789120660.602794:0:6360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120660.602808:0:6360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120660.602810:0:6360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789120660.602815:0:6360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789120660.604703:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789120660.604736:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120660.604748:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120660.604771:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120660.715328:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120661.741171:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120662.762823:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922270208:0@lo:400: 00000100:00100000:2.0:1789120662.762896:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120662.762976:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120662.762986:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922270336:0@lo:400: 00000100:00100000:2.0:1789120662.763038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120662.763078:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120662.763093:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270208 00000100:00100000:2.0:1789120662.763101:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270208 00000100:00100000:2.0:1789120662.763195:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789120662.763207:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:3317:x1876028922270208:12345-0@lo:400: 00000100:00100000:2.0:1789120662.763440:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:3317:x1876028922270208:12345-0@lo:400: Request processed in 68us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120662.763449:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789120662.763488:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270336 00000100:00100000:2.0:1789120662.763492:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270336 00000100:00100000:2.0:1789120662.763520:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120662.763527:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922270336:12345-0@lo:400: 00000100:00100000:2.0:1789120662.763564:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922270336:12345-0@lo:400: Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120662.763570:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789120662.763624:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffd91f64b40 x1876028922270336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120662.763638:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922270336:0@lo:400: 00000100:00100000:2.0:1789120662.763655:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922270208:0@lo:400: 00010000:00010000:3.0:1789120663.786520:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120664.810572:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789120665.783947:0:6702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789120665.783952:0:6702:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789120665.784074:0:6702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ffdaf537000 00000020:01000004:2.0:1789120665.784092:0:6702:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789120665.784106:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789120665.784120:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ffd8fb83490) 00000020:00000080:2.0:1789120665.784173:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789120665.815884:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789120665.816210:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:3.0:1789120665.834955:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789120665.861636:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789120665.874385:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789120665.874736:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789120665.874815:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789120665.875022:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789120665.876682:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789120665.876699:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789120665.876714:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x13cfa3d77faa4b2b 00000020:01000004:2.0:1789120665.876724:0:6702:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789120665.876751:0:6702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789120665.876755:0:6702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789120665.876762:0:6702:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789120665.876777:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789120665.876793:0:6702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ffd8fb84ed8) 00000020:00000080:2.0:1789120665.876805:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789120665.884139:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120665.884428:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789120665.884435:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789120665.886125:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789120665.886140:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789120665.890908:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120665.890928:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789120665.893417:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120665.893642:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789120665.893650:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789120665.894633:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789120665.894643:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789120665.920285:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120665.920588:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789120665.920606:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789120665.922673:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789120665.922698:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789120665.924165:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789120665.924179:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789120665.927640:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120665.927884:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789120665.927891:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789120665.929701:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789120665.929716:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789120666.022288:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120666.032660:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789120666.032681:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789120666.035656:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789120666.035690:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789120666.036995:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789120666.037044:0:6702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789120666.037059:0:6702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789120666.091946:0:6702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789120666.091983:0:6702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789120666.091988:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789120666.091990:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789120666.091991:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120666.091992:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120666.091994:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120666.091995:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120666.091997:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120666.091998:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120666.092000:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120666.092002:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120666.092003:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120666.092007:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789120666.092009:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120666.092011:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789120666.092013:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120666.092014:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120666.092015:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120666.092016:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120666.092017:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120666.092018:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120666.092019:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120666.092020:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120666.092021:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120666.092047:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789120666.092065:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922270464:0@lo:253: 00000100:00100000:0.0:1789120666.092179:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.092240:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.092346:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270464 00000100:00100000:2.0:1789120666.092361:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270464 00000100:00100000:2.0:1789120666.092460:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789120666.092472:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922270464:12345-0@lo:253: 20000000:01000000:2.0:1789120666.092524:0:5850:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789120666.092529:0:5850:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789120666.092536:0:5850:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789120666.092540:0:5850:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789120666.093972:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120666.094362:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789120666.094390:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789120666.094450:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789120666.094467:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789120666.094516:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789120666.094582:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789120666.094988:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789120666.095024:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:2.0:1789120666.095026:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789120666.095072:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789120666.095089:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789120666.095200:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789120666.095982:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:2.0:1789120666.096067:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789120666.096082:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789120666.096459:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789120666.096588:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789120666.097404:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789120666.097432:0:5850:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:2.0:1789120666.097434:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789120666.097485:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789120666.097512:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789120666.097549:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789120666.097556:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:2.0:1789120666.097604:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789120666.097614:0:5850:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789120666.097644:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789120666.097674:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789120666.097691:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789120666.097694:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789120666.097701:0:5850:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789120666.097703:0:5850:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789120666.097705:0:5850:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789120666.097720:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789120666.097723:0:5850:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789120666.097761:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789120666.097764:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789120666.099532:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789120666.099643:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789120666.099714:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789120666.100584:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789120666.100652:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789120666.100729:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789120666.100746:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789120666.100749:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789120666.101390:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789120666.101465:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789120666.101520:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789120666.102887:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789120666.102948:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789120666.102988:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789120666.103003:0:5850:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789120666.103006:0:5850:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789120666.103580:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789120666.103890:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789120666.103934:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789120666.104001:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1789120666.104023:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789120666.104045:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104081:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104088:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104095:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104103:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104419:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104439:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.104456:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270592:0@lo:104: 00000100:00100000:2.0:1789120666.104534:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120666.104662:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104671:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 12 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.104681:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270720:0@lo:104: 00000100:00100000:2.0:1789120666.104705:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120666.104797:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.104816:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 12 pid: 5850 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.104826:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270848:0@lo:104: 00000100:00100000:2.0:1789120666.104851:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.104912:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270592 00000100:00100000:3.0:1789120666.104921:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270592 00000100:00100000:3.0:1789120666.104966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270720 00000100:00100000:3.0:1789120666.104969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270720 00000100:00100000:3.0:1789120666.104987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.104997:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5850:x1876028922270592:12345-0@lo:104: 00010000:00010000:3.0:1789120666.105012:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105081:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120666.105087:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5850:x1876028922270592:12345-0@lo:104: Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.105096:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.105127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120666.105134:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5850:x1876028922270720:12345-0@lo:104: 00010000:00010000:3.0:1789120666.105189:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105226:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120666.105232:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5850:x1876028922270720:12345-0@lo:104: Request processed in 99us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.105250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789120666.105274:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120666.105281:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105289:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149ba00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120666.105293:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105302:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120666.105310:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120666.105316:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120666.105348:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105355:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120666.105373:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105380:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ba00/0x13cfa3d77faa4ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ade expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105402:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120666.105405:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105411:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690000 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120666.105414:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105421:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120666.105428:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120666.105433:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120666.105447:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105453:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120666.105458:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105465:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa4a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105477:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120666.105479:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120666.105481:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120666.105503:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922270976:0@lo:103: 00000100:00100000:3.0:1789120666.105542:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.105568:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120666.105574:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922271104:0@lo:103: 00000100:00100000:3.0:1789120666.105612:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.105650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270976 00000100:00100000:3.0:1789120666.105655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270976 00010000:00010000:3.0:1789120666.105674:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 13 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.105697:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271104 00000100:00100000:3.0:1789120666.105699:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271104 00010000:00010000:3.0:1789120666.105709:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.105721:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.105727:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:3319:x1876028922270976:12345-0@lo:103: 00010000:00010000:3.0:1789120666.105737:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120666.105742:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105751:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105781:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120666.105810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:3319:x1876028922270976:12345-0@lo:103: Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.105816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.105829:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120666.105836:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3319:x1876028922271104:12345-0@lo:103: 00010000:00010000:3.0:1789120666.105852:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120666.105858:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 13 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105867:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 13 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.105876:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120666.105899:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3319:x1876028922271104:12345-0@lo:103: Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.105906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120666.105945:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922271104:0@lo:103: 00000100:00100000:3.0:1789120666.105957:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922270976:0@lo:103: 00010000:00010000:1.0:1789120666.106062:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120666.107819:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781300 going to sleep for 11 seconds 00010000:00010000:2.0:1789120666.107984:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4ad7 expref: 12 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.108021:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270592:0@lo:104: 00010000:00010000:2.0:1789120666.108039:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148a600/0x13cfa3d77faa4a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4a67 expref: 11 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.108056:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270720:0@lo:104: 00000100:00100000:1.0:1789120666.110370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922270848 00000100:00100000:1.0:1789120666.110392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922270848 00000100:00100000:1.0:1789120666.110479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120666.110521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5850:x1876028922270848:12345-0@lo:104: 00010000:00010000:1.0:1789120666.110543:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.110689:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120666.110695:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5850:x1876028922270848:12345-0@lo:104: Request processed in 179us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.110703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789120666.110732:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120666.110738:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.110746:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690e00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120666.110751:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.110759:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120666.110765:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120666.110785:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120666.111042:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.111050:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789120666.111091:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922271232:0@lo:103: 00000100:00100000:2.0:1789120666.114606:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120666.114619:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.114665:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81690e00/0x13cfa3d77faa4a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4a52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.114692:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.114696:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.114698:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120666.114758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271232 00000100:00100000:2.0:1789120666.114781:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271232 00010000:00010000:2.0:1789120666.114985:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 11 pid: 5850 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.115041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120666.115053:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3317:x1876028922271232:12345-0@lo:103: 00010000:00010000:2.0:1789120666.115072:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120666.115079:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 11 pid: 5850 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115105:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 11 pid: 5850 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115133:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115163:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115183:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115191:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115198:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115205:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115211:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149b200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120666.115216:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115225:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115248:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115383:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120666.115622:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3317:x1876028922271232:12345-0@lo:103: Request processed in 571us (4477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.115631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789120666.115692:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148b600/0x13cfa3d77faa4a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4a4b expref: 10 pid: 5850 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.115706:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5850:1876028922270848:0@lo:104: 00010000:00010000:2.0:1789120666.115744:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115754:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115761:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.115781:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789120666.115796:0:5850:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789120666.116208:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922271232:0@lo:103: 00000100:00100000:1.0:1789120666.175455:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:6702:x1876028922270464:12345-0@lo:253: Request processed in 82973us (83302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.175478:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120666.175618:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922270464:0@lo:253: 10000000:01000000:0.0:1789120666.175636:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789120666.175640:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120666.175642:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789120666.175661:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120666.175663:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789120666.175664:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120666.175666:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120666.175667:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120666.175669:0:6702:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789120666.175671:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120666.175673:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789120666.175698:0:6702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffdaf537000 from lustre-OST0000 10000000:01000000:0.0:1789120666.175730:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789120666.175733:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789120666.175741:0:6702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffd9cd18000 local copy 10000000:01000000:0.0:1789120666.175745:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120666.175801:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.175814:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.175825:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.175846:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271360:0@lo:101: 00000100:00100000:0.0:1789120666.175890:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.176099:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.176392:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271360 00000100:00100000:2.0:1789120666.176400:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271360 00000100:00100000:2.0:1789120666.176497:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789120666.176509:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:6702:x1876028922271360:12345-0@lo:101: 00010000:00010000:2.0:1789120666.176525:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120666.176543:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b40 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.176590:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b40 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.176603:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b40 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.176615:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b200, rc 0) 00000100:00100000:2.0:1789120666.176670:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:6702:x1876028922271360:12345-0@lo:101: Request processed in 163us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.176677:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789120666.176757:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271360:0@lo:101: 00010000:00010000:0.0:1789120666.176785:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.176796:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.176943:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271488:0@lo:501: 00000100:00100000:0.0:1789120666.176979:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.177192:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.177295:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271488 00000100:00100000:3.0:1789120666.177300:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271488 00000100:00100000:3.0:1789120666.177339:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120666.177347:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:6702:x1876028922271488:12345-0@lo:501: 00000100:00100000:3.0:1789120666.177655:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:6702:x1876028922271488:12345-0@lo:501: Request processed in 308us (674us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789120666.177663:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120666.177894:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271488:0@lo:501: 10000000:01000000:0.0:1789120666.177909:0:6702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789120666.177944:0:6702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789120666.177951:0:6702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.177963:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.177971:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178103:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789120666.178131:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffdaf537000 10000000:01000000:0.0:1789120666.178136:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789120666.178173:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ffd9cd18000 10000000:01000000:0.0:1789120666.178177:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789120666.178181:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ffd9cd18000 from 1 10000000:01000000:0.0:1789120666.178184:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789120666.178212:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178220:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178230:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.178259:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271616:0@lo:101: 00000100:00100000:0.0:1789120666.178298:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.178350:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.178503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271616 00000100:00100000:3.0:1789120666.178508:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271616 00000100:00100000:3.0:1789120666.178550:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120666.178558:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+10:6702:x1876028922271616:12345-0@lo:101: 00010000:00010000:3.0:1789120666.178569:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120666.178582:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390ba00/0x13cfa3d77faa4b55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b4e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.178617:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390ba00/0x13cfa3d77faa4b55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b4e expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.178628:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390ba00/0x13cfa3d77faa4b55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b4e expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.178636:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ba00, rc 0) 00000100:00100000:3.0:1789120666.178681:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922271616:12345-0@lo:101: Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.178688:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789120666.178816:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271616:0@lo:101: 00010000:00010000:0.0:1789120666.178830:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178839:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.178856:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789120666.178873:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178880:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.178887:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789120666.178891:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120666.178896:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789120666.178898:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789120666.178915:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178922:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.178929:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.178951:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271744:0@lo:101: 00000100:00100000:0.0:1789120666.178980:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120666.179095:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271744 00000100:00100000:2.0:1789120666.179100:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271744 00000100:00100000:2.0:1789120666.179129:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789120666.179136:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922271744:12345-0@lo:101: 00010000:00010000:2.0:1789120666.179165:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120666.179177:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b5c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.179193:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.179200:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.179207:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a800, rc 0) 00000100:00100000:0.0:1789120666.179267:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd000 going to sleep for 11 seconds 00010000:00010000:1.0:1789120666.179447:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120666.179456:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.179464:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148bc00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120666.179469:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.179477:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120666.179483:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120666.179489:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120666.179512:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.179518:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789120666.179576:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789120666.179597:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.179613:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4b47 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.179627:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.179628:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.179630:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120666.179794:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922271744:12345-0@lo:101: Request processed in 656us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.179801:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789120666.179878:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922271872:0@lo:103: 00000100:00100000:0.0:1789120666.179913:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.180092:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922271744:0@lo:101: 00010000:00010000:3.0:1789120666.180107:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.180116:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.180273:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272000:0@lo:501: 00000100:00100000:3.0:1789120666.180303:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.180426:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272000 00000100:00100000:0.0:1789120666.180432:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272000 00000100:00100000:0.0:1789120666.180472:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120666.180482:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272000:12345-0@lo:501: 00000100:00100000:0.0:1789120666.180758:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272000:12345-0@lo:501: Request processed in 276us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.180778:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120666.180868:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.180885:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272000:0@lo:501: 00000100:00100000:3.0:1789120666.180922:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272128:0@lo:503: 00000100:00100000:3.0:1789120666.180966:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.180992:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.181101:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272128 00000100:00100000:0.0:1789120666.181106:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272128 00000100:00100000:0.0:1789120666.181134:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120666.181163:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272128:12345-0@lo:503: 00000100:00100000:0.0:1789120666.181410:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272128:12345-0@lo:503: Request processed in 268us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.181418:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120666.181525:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272128:0@lo:503: 00000040:00080000:3.0:1789120666.181920:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120666.182291:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272256:0@lo:502: 00000100:00100000:3.0:1789120666.182430:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.182518:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.182601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922271872 00000100:00100000:2.0:1789120666.182608:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922271872 00000100:00100000:2.0:1789120666.182665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120666.182675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:3317:x1876028922271872:12345-0@lo:103: 00010000:00010000:2.0:1789120666.182690:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120666.182712:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4b40 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.182732:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120666.182794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3317:x1876028922271872:12345-0@lo:103: Request processed in 120us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.182802:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120666.182918:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922271872:0@lo:103: 00000100:00100000:0.0:1789120666.182965:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272256 00000100:00100000:0.0:1789120666.182969:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272256 00000100:00100000:0.0:1789120666.183101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120666.183110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922272256:12345-0@lo:502: 00000100:00100000:0.0:1789120666.183370:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922272256:12345-0@lo:502: Request processed in 261us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.183388:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120666.183478:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272256:0@lo:502: 00000040:00080000:3.0:1789120666.183751:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789120666.183816:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789120666.183850:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789120666.183899:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789120666.183938:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789120666.183972:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789120666.184005:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272384:0@lo:502: 00000100:00100000:3.0:1789120666.184054:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.184472:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.184559:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272384 00000100:00100000:2.0:1789120666.184566:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272384 00000100:00100000:2.0:1789120666.184604:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789120666.184613:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922272384:12345-0@lo:502: 00000100:00100000:2.0:1789120666.184831:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922272384:12345-0@lo:502: Request processed in 218us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.184838:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120666.184935:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272384:0@lo:502: 00000040:00080000:3.0:1789120666.185075:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789120666.185089:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789120666.185892:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789120666.185902:0:6720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789120666.185921:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120666.185924:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789120666.185931:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120666.185949:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ffd955d1a48) 00000020:00000080:3.0:1789120666.185974:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789120666.185981:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789120666.186043:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdaf537000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789120666.186050:0:6720:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789120666.186057:0:6720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x13cfa3d77faa4b71 00010000:00010000:3.0:1789120666.190520:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789120666.191299:0:6720:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789120666.207207:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789120666.207640:0:6720:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789120666.237135:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789120666.239607:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789120666.252327:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789120666.252346:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120666.252355:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120666.252358:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789120666.252365:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120666.252370:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120666.252371:0:6720:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789120666.252374:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120666.252377:0:6720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789120666.252431:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120666.252435:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120666.252436:0:6720:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789120666.252440:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789120666.252911:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789120666.252939:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789120666.252966:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.252980:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.252990:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaf537000 from 1 10000000:01000000:0.0:1789120666.252993:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120666.253036:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.253045:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.253057:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.253083:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272512:0@lo:101: 00000100:00100000:0.0:1789120666.253192:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.253263:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.254463:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272512 00000100:00100000:2.0:1789120666.254478:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272512 00000100:00100000:2.0:1789120666.254545:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120666.254556:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:6702:x1876028922272512:12345-0@lo:101: 00010000:00010000:2.0:1789120666.254574:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120666.254592:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b78 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.254622:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.254642:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.254652:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b200, rc 0) 00000100:00100000:2.0:1789120666.254727:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272512:12345-0@lo:101: Request processed in 172us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.254734:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789120666.255464:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272512:0@lo:101: 00010000:00010000:0.0:1789120666.255486:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.255510:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.255649:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272640:0@lo:501: 00000100:00100000:0.0:1789120666.255698:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.255750:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.256955:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272640 00000100:00100000:1.0:1789120666.256967:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272640 00000100:00100000:1.0:1789120666.257022:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120666.257034:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272640:12345-0@lo:501: 00000100:00100000:1.0:1789120666.262305:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272640:12345-0@lo:501: Request processed in 5258us (6592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.263013:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272640:0@lo:501: 00000100:00100000:0.0:1789120666.263092:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272768:0@lo:503: 00000100:00100000:0.0:1789120666.263181:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.263238:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.264037:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272768 00000100:00100000:2.0:1789120666.264053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272768 00000100:00100000:2.0:1789120666.264109:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120666.264120:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922272768:12345-0@lo:503: 00000100:00100000:1.0:1789120666.264670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120666.265726:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272768:12345-0@lo:503: Request processed in 1601us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.265738:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789120666.266576:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272768:0@lo:503: 00000040:00080000:0.0:1789120666.267189:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789120666.267305:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272896:0@lo:502: 00000100:00100000:0.0:1789120666.269235:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.269291:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.269941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922272896 00000100:00100000:1.0:1789120666.269953:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922272896 00000100:00100000:1.0:1789120666.270027:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120666.270038:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272896:12345-0@lo:502: 00000100:00100000:1.0:1789120666.271043:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922272896:12345-0@lo:502: Request processed in 1000us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.271055:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120666.271749:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922272896:0@lo:502: 00000040:00080000:1.0:1789120666.277096:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789120666.277248:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789120666.277309:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273024:0@lo:502: 00000100:00100000:1.0:1789120666.277423:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.277493:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda1372a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.277555:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273024 00000100:00100000:3.0:1789120666.277569:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273024 00000100:00100000:3.0:1789120666.277636:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120666.277648:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922273024:12345-0@lo:502: 00000100:00100000:3.0:1789120666.277953:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922273024:12345-0@lo:502: Request processed in 307us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.277962:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789120666.278019:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273024:0@lo:502: 00000040:00080000:0.0:1789120666.278176:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789120666.278193:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789120666.283386:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120666.283405:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120666.283408:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789120666.283421:0:6724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdaf537000 00000020:00000080:2.0:1789120666.283423:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120666.283447:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120666.283450:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120666.283452:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789120666.283455:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789120666.283647:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789120666.283681:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120666.283710:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.283724:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120666.283784:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789120666.283788:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffdaf537000 10000000:01000000:3.0:1789120666.283792:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffdaf537000 10000000:01000000:3.0:1789120666.283811:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789120666.283819:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdaf537000 from 1 10000000:01000000:3.0:1789120666.283822:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120666.283867:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.283876:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.283886:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.283929:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273152:0@lo:101: 00000100:00100000:3.0:1789120666.284012:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.284063:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.284948:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273152 00000100:00100000:2.0:1789120666.284960:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273152 00000100:00100000:2.0:1789120666.285027:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789120666.285037:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922273152:12345-0@lo:101: 00010000:00010000:2.0:1789120666.285053:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120666.285083:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4b86 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.285111:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.285122:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.285133:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b000, rc 0) 00000100:00100000:2.0:1789120666.285213:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273152:12345-0@lo:101: Request processed in 178us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.285221:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789120666.286031:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273152:0@lo:101: 00010000:00010000:3.0:1789120666.286055:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.286068:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.286262:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273280:0@lo:501: 00000100:00100000:3.0:1789120666.286346:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.286398:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.286570:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273280 00000100:00100000:1.0:1789120666.286578:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273280 00000100:00100000:1.0:1789120666.286626:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789120666.286637:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273280:12345-0@lo:501: 00000100:00100000:1.0:1789120666.286974:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273280:12345-0@lo:501: Request processed in 337us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.286982:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120666.288998:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273280:0@lo:501: 00000100:00100000:3.0:1789120666.289075:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273408:0@lo:503: 00000100:00100000:3.0:1789120666.289180:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.289238:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.290007:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273408 00000100:00100000:0.0:1789120666.290017:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273408 00000100:00100000:0.0:1789120666.290095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120666.290107:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273408:12345-0@lo:503: 00000100:00100000:0.0:1789120666.290456:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273408:12345-0@lo:503: Request processed in 350us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.290474:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120666.291288:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273408:0@lo:503: 00000040:00080000:3.0:1789120666.292911:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120666.294558:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273536:0@lo:502: 00000100:00100000:3.0:1789120666.294717:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.294789:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.296125:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273536 00000100:00100000:1.0:1789120666.296158:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273536 00000100:00100000:1.0:1789120666.296234:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120666.296245:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273536:12345-0@lo:502: 00000100:00100000:1.0:1789120666.296592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273536:12345-0@lo:502: Request processed in 347us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.296611:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120666.296855:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273536:0@lo:502: 00000040:00080000:3.0:1789120666.297250:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789120666.297327:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789120666.297366:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789120666.297555:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789120666.297596:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789120666.297651:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789120666.297687:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789120666.297720:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789120666.297783:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789120666.297821:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789120666.297859:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789120666.297910:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789120666.297947:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789120666.297981:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789120666.298049:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789120666.298091:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789120666.298129:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789120666.300110:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789120666.300556:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789120666.300629:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789120666.300690:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789120666.300728:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789120666.300784:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789120666.300840:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789120666.300880:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789120666.300916:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789120666.300968:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789120666.301339:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789120666.301658:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273664:0@lo:502: 00000100:00100000:3.0:1789120666.301759:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.301889:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.302472:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273664 00000100:00100000:1.0:1789120666.302483:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273664 00000100:00100000:1.0:1789120666.302547:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120666.302558:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273664:12345-0@lo:502: 00000100:00100000:1.0:1789120666.302997:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922273664:12345-0@lo:502: Request processed in 439us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.303007:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789120666.303327:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922273664:0@lo:502: 00000040:00080000:3.0:1789120666.303471:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789120666.303496:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789120666.304484:0:6725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789120666.304570:0:6725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ffd955d3490) 00000020:00000080:3.0:1789120666.304596:0:6725:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789120666.304695:0:6725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdaf537000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789120666.304700:0:6725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffdaf537000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789120666.304703:0:6725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdaf537000 3 00010000:00080000:3.0:1789120666.304745:0:6725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffc81847000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789120666.308084:0:6725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789120666.308569:0:6725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789120666.308614:0:6725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789120666.308630:0:6725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x13cfa3d77faa4b9b 00000100:00080000:3.0:1789120666.308643:0:6725:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789120666.308662:0:6725:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ffc81847000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120666.308715:0:6725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffda31fed00 x1876028922273792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789120666.308748:0:6725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789120666.309260:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922273792:0@lo:38: 00000100:00100000:0.0:1789120666.309348:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.309473:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273792 00000100:00100000:3.0:1789120666.309481:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273792 00000100:00100000:3.0:1789120666.309541:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.309549:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1876028922273792:12345-0@lo:38: 00010000:00080000:3.0:1789120666.309576:0:5858:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:3.0:1789120666.309610:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x13cfa3d77faa4ba2 00000004:00100000:3.0:1789120666.309628:0:5858:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789120666.309678:0:5858:0:(import.c:65:import_set_state_nolock()) ffff9ffc81841800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120666.309746:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876028922273792:12345-0@lo:38: Request processed in 196us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.309753:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789120666.309878:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffda31fed00 x1876028922273792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120666.309889:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789120666.309898:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789120666.309906:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789120666.309910:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789120666.309913:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffc81847000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789120666.309920:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922273792:0@lo:38: 00000100:00100000:3.0:1789120666.310778:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922273920:0@lo:400: 00000100:00100000:3.0:1789120666.310835:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120666.310962:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922273920 00000100:00100000:2.0:1789120666.310969:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922273920 00000100:00100000:2.0:1789120666.311025:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120666.311036:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922273920:12345-0@lo:400: 00000100:00100000:2.0:1789120666.311089:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922273920:12345-0@lo:400: Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.311097:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789120666.311288:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffd91f661c0 x1876028922273920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120666.311302:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922273920:0@lo:400: 00000040:00080000:3.0:1789120666.311525:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789120666.311710:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789120666.311739:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789120666.311777:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.311789:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789120666.312039:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789120666.312042:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120666.312047:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120666.312048:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120666.312049:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120666.312051:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120666.312052:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120666.312054:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789120666.312055:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789120666.312057:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120666.312058:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789120666.312062:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789120666.312065:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789120666.312066:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120666.312067:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120666.312068:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120666.312069:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120666.312070:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120666.312070:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120666.312071:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789120666.312072:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789120666.312073:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120666.312074:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789120666.312096:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789120666.312114:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922274048:0@lo:253: 00000100:00100000:2.0:1789120666.312199:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.312249:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274048 00000100:00100000:2.0:1789120666.312253:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda03d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.312255:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274048 00000100:00100000:3.0:1789120666.312302:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789120666.312313:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6702:x1876028922274048:12345-0@lo:253: 20000000:01000000:3.0:1789120666.312339:0:5851:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789120666.312356:0:5851:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789120666.355428:0:5851:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789120666.355451:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789120666.355936:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789120666.355944:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789120666.355973:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.355995:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.356004:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.356054:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.356072:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 13 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.356112:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922274176:0@lo:104: 00000100:00100000:0.0:1789120666.356249:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.356339:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.356609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274176 00000100:00100000:1.0:1789120666.356619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274176 00000100:00100000:1.0:1789120666.356677:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120666.356688:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922274176:12345-0@lo:104: 00010000:00010000:1.0:1789120666.356703:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.356787:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120666.356793:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922274176:12345-0@lo:104: Request processed in 108us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.356952:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922274176:0@lo:104: 00010000:00010000:3.0:1789120666.356976:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120666.357020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789120666.357051:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120666.357058:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357067:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120666.357072:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357096:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120666.357103:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120666.357110:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120666.357238:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357247:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120666.357267:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357275:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a200/0x13cfa3d77faa4b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357292:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.357294:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120666.357296:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120666.357305:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120666.357329:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922274304:0@lo:103: 00000100:00100000:1.0:1789120666.357372:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.357422:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274304 00000100:00100000:1.0:1789120666.357427:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274304 00010000:00010000:1.0:1789120666.357449:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120666.357474:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120666.357482:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdaa249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:3319:x1876028922274304:12345-0@lo:103: 00010000:00010000:1.0:1789120666.357500:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120666.357506:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357517:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4b08 expref: 14 pid: 5852 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357546:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357555:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789120666.357569:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001697612s 00010000:00010000:1.0:1789120666.357574:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357582:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357589:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357596:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357602:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148a200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120666.357606:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357620:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357636:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.357646:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120666.357688:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdaa249050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3319:x1876028922274304:12345-0@lo:103: Request processed in 206us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.357696:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120666.357783:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922274304:0@lo:103: 00010000:00010000:1.0:1789120666.358278:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.358289:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.358296:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148a200/0x13cfa3d77faa4ba9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.385339:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:6702:x1876028922274048:12345-0@lo:253: Request processed in 73005us (73117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.385357:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789120666.385539:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:6702:1876028922274048:0@lo:253: 10000000:01000000:2.0:1789120666.385559:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789120666.385563:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789120666.385565:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120666.385566:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120666.385568:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120666.385569:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120666.385570:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120666.385572:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120666.385574:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789120666.385576:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789120666.385577:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120666.385579:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789120666.385614:0:6702:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789120666.396695:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120666.397079:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120666.397578:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120666.397851:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120666.398591:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120666.398796:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789120666.400068:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789120666.622682:0:6702:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789120666.622692:0:6702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789120666.622740:0:6702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789120666.622829:0:6702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789120666.622861:0:6702:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789120666.622891:0:6702:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1789120666.701042:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789120666.701050:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd85287800 from 21 10000000:01000000:2.0:1789120666.701056:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120666.701106:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.701119:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120666.701130:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120666.701616:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274432:0@lo:101: 00000100:00100000:2.0:1789120666.702386:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120666.702492:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.705273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274432 00000100:00100000:1.0:1789120666.705286:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274432 00000100:00100000:1.0:1789120666.705439:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120666.705460:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922274432:12345-0@lo:101: 00010000:00010000:1.0:1789120666.705478:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120666.705496:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4bb0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.705523:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.705534:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.705543:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690e00, rc 0) 00000100:00100000:1.0:1789120666.705624:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922274432:12345-0@lo:101: Request processed in 166us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.705638:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789120666.705717:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274432:0@lo:101: 00010000:00010000:3.0:1789120666.705735:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.705746:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120666.706049:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274560:0@lo:501: 00000100:00100000:3.0:1789120666.706085:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.706329:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.706455:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274560 00000100:00100000:2.0:1789120666.706462:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274560 00000100:00100000:2.0:1789120666.706491:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789120666.706499:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922274560:12345-0@lo:501: 00000100:00100000:2.0:1789120666.706741:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922274560:12345-0@lo:501: Request processed in 242us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.706749:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789120666.709471:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274560:0@lo:501: 00000100:00100000:3.0:1789120666.709543:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274688:0@lo:503: 00000100:00100000:3.0:1789120666.709608:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.709665:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.709774:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274688 00000100:00100000:2.0:1789120666.709781:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274688 00000100:00100000:2.0:1789120666.709982:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120666.709992:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922274688:12345-0@lo:503: 00000100:00100000:2.0:1789120666.710238:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922274688:12345-0@lo:503: Request processed in 247us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.710246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789120666.713349:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922274688:0@lo:503: 00000100:00100000:3.0:1789120666.715359:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6731:1876028922274816:0@lo:502: 00000100:00100000:3.0:1789120666.715435:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.715483:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.715525:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274816 00000100:00100000:0.0:1789120666.715532:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274816 00000100:00100000:0.0:1789120666.715573:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789120666.715583:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6731:x1876028922274816:12345-0@lo:502: 00000100:00100000:0.0:1789120666.715853:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6731:x1876028922274816:12345-0@lo:502: Request processed in 271us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.715862:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789120666.716422:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6731:1876028922274816:0@lo:502: 00000100:00100000:3.0:1789120666.716480:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6731:1876028922274944:0@lo:502: 00000100:00100000:3.0:1789120666.716519:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.716542:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.717233:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922274944 00000100:00100000:0.0:1789120666.717241:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922274944 00000100:00100000:0.0:1789120666.717279:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120666.717288:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6731:x1876028922274944:12345-0@lo:502: 00000100:00100000:0.0:1789120666.717511:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:6731:x1876028922274944:12345-0@lo:502: Request processed in 224us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.717519:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120666.717667:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6731:1876028922274944:0@lo:502: 00000040:00080000:3.0:1789120666.717697:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789120666.718198:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789120666.718219:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120666.718229:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718240:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.718259:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789120666.718262:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd85287800 from 4 10000000:01000000:0.0:1789120666.718265:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789120666.718296:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718303:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718322:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.718341:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275072:0@lo:101: 00000100:00100000:0.0:1789120666.718382:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.718416:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.718440:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275072 00000100:00100000:0.0:1789120666.718445:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275072 00000100:00100000:0.0:1789120666.718480:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120666.718488:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922275072:12345-0@lo:101: 00010000:00010000:0.0:1789120666.718498:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120666.718510:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4bbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718533:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718543:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.718562:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8148aa00, rc 0) 00000100:00100000:0.0:1789120666.718599:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922275072:12345-0@lo:101: Request processed in 111us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.718606:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120666.720472:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275072:0@lo:101: 00010000:00010000:0.0:1789120666.720500:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.720512:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.720581:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275200:0@lo:256: 00000100:00100000:0.0:1789120666.720647:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.720686:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.720721:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275200 00000100:00100000:0.0:1789120666.720727:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275200 00000100:00100000:0.0:1789120666.720800:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120666.720813:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922275200:12345-0@lo:256: 20000000:01000000:0.0:1789120666.720835:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789120666.720852:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789120666.720856:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789120666.720951:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922275200:12345-0@lo:256: Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.720960:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120666.721003:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275200:0@lo:256: 10000000:01000000:0.0:1789120666.721045:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789120666.721057:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721066:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.721076:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789120666.721079:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789120666.721082:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789120666.721106:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721114:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721122:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.721134:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275328:0@lo:101: 00000100:00100000:0.0:1789120666.721185:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.721200:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.721212:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275328 00000100:00100000:0.0:1789120666.721216:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275328 00000100:00100000:0.0:1789120666.721238:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789120666.721244:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922275328:12345-0@lo:101: 00010000:00010000:0.0:1789120666.721253:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120666.721265:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4bcc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721283:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721302:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.721311:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8148ba00, rc 0) 00000100:00100000:0.0:1789120666.721348:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922275328:12345-0@lo:101: Request processed in 103us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.721355:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789120666.721369:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275328:0@lo:101: 00010000:00010000:1.0:1789120666.721384:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120666.721394:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120666.721848:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275456:0@lo:501: 00000100:00100000:1.0:1789120666.721878:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.721910:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc810893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.722028:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275456 00000100:00100000:0.0:1789120666.722033:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275456 00000100:00100000:0.0:1789120666.722073:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789120666.722081:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922275456:12345-0@lo:501: 00000100:00100000:0.0:1789120666.722347:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922275456:12345-0@lo:501: Request processed in 266us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.722355:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789120666.722371:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275456:0@lo:501: 00000100:00100000:1.0:1789120666.722403:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275584:0@lo:503: 00000100:00100000:1.0:1789120666.722575:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.722619:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275584 00000100:00100000:0.0:1789120666.722625:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275584 00000100:00100000:0.0:1789120666.722649:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120666.722656:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922275584:12345-0@lo:503: 00000100:00100000:1.0:1789120666.722663:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc810893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.722873:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922275584:12345-0@lo:503: Request processed in 216us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.722879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789120666.723023:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922275584:0@lo:503: 00000100:00100000:3.0:1789120666.723813:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6732:1876028922275712:0@lo:502: 00000100:00100000:3.0:1789120666.723864:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.723911:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.724031:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275712 00000100:00100000:0.0:1789120666.724037:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275712 00000100:00100000:0.0:1789120666.724289:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120666.724300:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:6732:x1876028922275712:12345-0@lo:502: 00000100:00100000:0.0:1789120666.724753:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:6732:x1876028922275712:12345-0@lo:502: Request processed in 455us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.724778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789120666.729100:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6732:1876028922275712:0@lo:502: 00000020:01000000:3.0:1789120666.729156:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789120666.729164:0:6732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789120666.729173:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120666.729175:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789120666.729182:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789120666.729187:0:6732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:3.0:1789120666.737324:0:6732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789120666.737334:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120666.737357:0:6732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ffd955d4ed8) 00000020:00000080:3.0:1789120666.737379:0:6732:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789120666.737399:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789120666.737505:0:6732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789120666.737512:0:6732:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789120666.737519:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4be1 00010000:00080000:3.0:1789120666.737554:0:6732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffdb48b2000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789120666.737837:0:6732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789120666.802460:0:6732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789120666.802480:0:6732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789120666.803077:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120666.803340:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120666.803386:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789120666.803449:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789120666.807269:0:6737:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120666.807277:0:6737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789120666.809310:0:6732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789120666.809703:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789120666.809746:0:6732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789120666.809778:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa4be8 00000100:00080000:2.0:1789120666.809789:0:6732:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120666.809795:0:6732:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffdb48b2000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120666.809834:0:6732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffd91f652c0 x1876028922275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120666.809856:0:6732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789120666.809908:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120666.809912:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120666.809914:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789120666.809918:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120666.809922:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120666.809923:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789120666.809926:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120666.809928:0:6732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789120666.810078:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922275840:0@lo:8: 00000100:00100000:1.0:1789120666.810166:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.810294:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275840 00000100:00100000:1.0:1789120666.810300:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275840 00000100:00100000:1.0:1789120666.810415:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120666.810423:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876028922275840:12345-0@lo:8: 00010000:00080000:1.0:1789120666.810448:0:6705:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1789120666.810474:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa4bef 00002000:00100000:1.0:1789120666.810508:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ffc819e5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789120666.810513:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789120666.810516:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789120666.810634:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789120666.810806:0:6705:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120666.810833:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9ffc819e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120666.810888:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876028922275840:12345-0@lo:8: Request processed in 464us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.810896:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120666.810924:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922276096:0@lo:400: 00000100:00100000:2.0:1789120666.811420:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6732:1876028922275968:0@lo:502: 00000100:00100000:2.0:1789120666.811469:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120666.811491:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.811512:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922275968 00000100:00100000:2.0:1789120666.811517:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922275968 00000100:00100000:2.0:1789120666.811551:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789120666.811559:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:6732:x1876028922275968:12345-0@lo:502: 00000100:00100000:1.0:1789120666.813051:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.813109:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120666.813120:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922276224:0@lo:400: 00000100:00100000:1.0:1789120666.813193:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120666.813241:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922276352:0@lo:400: 00000100:00100000:1.0:1789120666.813279:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789120666.814073:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9ffd91f652c0 x1876028922275840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120666.814085:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120666.814095:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789120666.814104:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789120666.814110:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789120666.814113:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdb48b2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789120666.814125:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789120666.814130:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922275840:0@lo:8: 00000100:00100000:1.0:1789120666.814182:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276096 00000100:00100000:1.0:1789120666.814188:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276096 00000100:00100000:1.0:1789120666.814220:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120666.814229:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3317:x1876028922276096:12345-0@lo:400: 00000100:00100000:1.0:1789120666.814284:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3317:x1876028922276096:12345-0@lo:400: Request processed in 56us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.814292:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120666.815064:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276224 00000100:00100000:1.0:1789120666.815069:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276224 00000100:00100000:1.0:1789120666.815100:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276352 00000100:00100000:1.0:1789120666.815103:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276352 00000100:00100000:1.0:1789120666.815129:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120666.815136:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922276224:12345-0@lo:400: 00000100:00100000:1.0:1789120666.815204:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922276224:12345-0@lo:400: Request processed in 68us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.815221:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120666.815235:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120666.815242:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922276352:12345-0@lo:400: 00000100:00100000:1.0:1789120666.815275:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922276352:12345-0@lo:400: Request processed in 34us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.815281:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789120666.815306:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789120666.816244:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffd832b92c0 x1876028922276352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120666.816259:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922276352:0@lo:400: 00010000:00080000:1.0:1789120666.816304:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffd832b8780 x1876028922276224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120666.816403:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922276224:0@lo:400: 00000100:00100000:1.0:1789120666.816417:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922276096:0@lo:400: 00000004:00080000:1.0:1789120666.816444:0:6737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789120666.816566:0:6737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 134070421318ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789120666.823632:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:6732:x1876028922275968:12345-0@lo:502: Request processed in 12064us (12154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120666.823645:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789120666.823969:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:6732:1876028922275968:0@lo:502: 00000020:01000000:0.0:1789120666.824004:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120666.824012:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120666.824013:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789120666.824018:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789120666.829888:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789120666.829924:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789120666.829936:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.830025:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120666.830036:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789120666.830039:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffd9cd18000 from 1 10000000:01000000:0.0:1789120666.830043:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120666.830088:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.830097:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.830107:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.830132:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922276480:0@lo:101: 00000100:00100000:0.0:1789120666.830395:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.830460:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120666.830505:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276480 00000100:00100000:0.0:1789120666.830512:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276480 00000100:00100000:0.0:1789120666.830558:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120666.830567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922276480:12345-0@lo:101: 00010000:00010000:0.0:1789120666.830580:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120666.830783:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4bf6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.831134:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.831176:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.832036:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b600, rc 0) 00000100:00100000:0.0:1789120666.832111:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922276480:12345-0@lo:101: Request processed in 1543us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120666.832119:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120666.832209:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922276480:0@lo:101: 00010000:00010000:0.0:1789120666.832230:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120666.832240:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120666.832302:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922276608:0@lo:501: 00000100:00100000:0.0:1789120666.834269:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120666.834325:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.834377:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276608 00000100:00100000:3.0:1789120666.834386:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276608 00000100:00100000:3.0:1789120666.834434:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120666.834443:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922276608:12345-0@lo:501: 00000100:00100000:3.0:1789120666.834751:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922276608:12345-0@lo:501: Request processed in 308us (486us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789120666.834760:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120666.834827:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922276608:0@lo:501: 10000000:01000000:3.0:1789120666.834865:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789120666.834884:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.834896:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120666.861855:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789120666.896007:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789120666.946675:0:6738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789120666.946703:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922276864:0@lo:7: 00000100:00100000:1.0:1789120666.946775:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.946809:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276864 00000100:00100000:3.0:1789120666.946817:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276864 00000100:00100000:1.0:1789120666.946825:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc810899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120666.946841:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922276736:0@lo:13: 00000100:00100000:1.0:1789120666.946864:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.946867:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120666.946876:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6738:x1876028922276864:12345-0@lo:7: 00000100:00100000:1.0:1789120666.949010:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276736 00000100:00100000:1.0:1789120666.949024:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276736 00000100:00100000:1.0:1789120666.949084:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120666.949094:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876028922276736:12345-0@lo:13: 00002000:00000024:1.0:1789120666.949120:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1789120666.949204:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876028922276736:12345-0@lo:13: Request processed in 111us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120666.949212:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789120666.949253:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd832b8780 x1876028922276736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120666.949273:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922276736:0@lo:13: 00000100:00080000:0.0:1789120666.950338:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789120666.955111:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789120666.955125:0:6707:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789120666.955232:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6738:x1876028922276864:12345-0@lo:7: Request processed in 8353us (8453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120666.955243:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789120666.955299:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd832b92c0 x1876028922276864/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120666.955314:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922276864:0@lo:7: 00000004:00080000:3.0:1789120666.955328:0:6738:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789120666.955364:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922276992:0@lo:5: 00000100:00100000:3.0:1789120666.955398:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.955512:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120666.955532:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922276992 00000100:00100000:3.0:1789120666.955538:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922276992 00000100:00100000:3.0:1789120666.955580:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120666.955589:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6738:x1876028922276992:12345-0@lo:5: 00002000:00080000:3.0:1789120666.955614:0:6706:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789120666.955618:0:6706:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789120666.956190:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6738:x1876028922276992:12345-0@lo:5: Request processed in 600us (789us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789120666.956199:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789120666.956234:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffda31ff0c0 x1876028922276992/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120666.956247:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922276992:0@lo:5: 00000004:00080000:3.0:1789120666.956256:0:6738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789120666.956284:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922277120:0@lo:700: 00000100:00100000:3.0:1789120666.956312:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120666.956344:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.956568:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277120 00000100:00100000:2.0:1789120666.956579:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277120 00000100:00100000:2.0:1789120666.956620:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120666.956630:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6738:x1876028922277120:12345-0@lo:700: 00000100:00100000:2.0:1789120666.956663:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1876028922277248:0@lo:700: 00000100:00100000:2.0:1789120666.956697:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120666.956715:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb97f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120666.956735:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277248 00000100:00100000:2.0:1789120666.956738:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277248 00000100:00100000:2.0:1789120666.956774:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120666.956781:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1876028922277248:12345-0@lo:700: 40000000:02000000:1.0:1789120666.994578:0:5864:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789120667.000795:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1876028922277248:12345-0@lo:700: Request processed in 44008us (44091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120667.000818:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789120667.001193:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91f64780 x1876028922277248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789120682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120667.001210:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1876028922277248:0@lo:700: 40000000:02000000:2.0:1789120667.001223:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1789120667.094267:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789120667.094300:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1789120667.094466:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6738:x1876028922277120:12345-0@lo:700: Request processed in 137833us (138148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120667.094480:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789120667.094576:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffda31fde00 x1876028922277120/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120667.094588:0:6738:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789120667.094604:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922277120:0@lo:700: 00000004:02000040:0.0:1789120667.145512:0:6738:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789120667.155723:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922277376:0@lo:5: 00000100:00100000:0.0:1789120667.156690:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120667.156749:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120667.157070:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277376 00000100:00100000:2.0:1789120667.157079:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277376 00000100:00100000:2.0:1789120667.157126:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120667.157135:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6738:x1876028922277376:12345-0@lo:5: 00002000:00080000:3.0:1789120667.175505:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789120667.175529:0:6705:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789120667.178908:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6738:x1876028922277376:12345-0@lo:5: Request processed in 21759us (22205us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120667.178921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789120667.178997:0:6738:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91e68780 x1876028922277376/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120683 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120667.179015:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6738:1876028922277376:0@lo:5: 00000004:00080000:1.0:1789120667.179030:0:6738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789120667.883771:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120668.910811:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120669.932025:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120670.958107:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120671.983578:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922277504:0@lo:400: 00000100:00100000:0.0:1789120671.983647:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120671.983700:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120671.983706:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922277632:0@lo:400: 00000100:00100000:0.0:1789120671.983752:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120671.983783:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922277760:0@lo:400: 00000100:00100000:0.0:1789120671.983806:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120671.983823:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120671.983828:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922277888:0@lo:400: 00000100:00100000:0.0:1789120671.983866:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120671.983899:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277504 00000100:00100000:0.0:1789120671.983905:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277504 00000100:00100000:0.0:1789120671.983949:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120671.983958:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3317:x1876028922277504:12345-0@lo:400: 00000100:00100000:0.0:1789120671.984007:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3317:x1876028922277504:12345-0@lo:400: Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120671.984024:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120671.984069:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277632 00000100:00100000:0.0:1789120671.984073:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277632 00000100:00100000:0.0:1789120671.984098:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277760 00000100:00100000:0.0:1789120671.984101:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277760 00000100:00100000:0.0:1789120671.984125:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120671.984131:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922277632:12345-0@lo:400: 00000100:00100000:0.0:1789120671.984179:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922277632:12345-0@lo:400: Request processed in 48us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120671.984185:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120671.984197:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120671.984203:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922277760:12345-0@lo:400: 00000100:00100000:0.0:1789120671.984233:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922277760:12345-0@lo:400: Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120671.984239:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120671.984260:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922277888 00000100:00100000:0.0:1789120671.984264:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922277888 00010000:00010000:2.0:1789120671.985239:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120671.997681:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120671.997709:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922278016:0@lo:13: 00000100:00100000:3.0:1789120671.997791:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120671.997872:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120671.997886:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922277888:12345-0@lo:400: 00000100:00100000:3.0:1789120671.997937:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922277888:12345-0@lo:400: Request processed in 57us (14069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120671.997944:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789120671.997990:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91e6a1c0 x1876028922277888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120671.998004:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922277888:0@lo:400: 00010000:00080000:3.0:1789120671.998024:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91e6ad00 x1876028922277760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120671.998032:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922277760:0@lo:400: 00000100:00080000:3.0:1789120671.998071:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120671.998077:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120671.998102:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91e692c0 x1876028922277632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120671.998112:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922277632:0@lo:400: 00000100:00100000:3.0:1789120671.998123:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922277504:0@lo:400: 00000100:00100000:0.0:1789120671.998365:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278016 00000100:00100000:0.0:1789120671.998373:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278016 00000100:00100000:0.0:1789120671.998412:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120671.998419:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922278016:12345-0@lo:13: 00002000:00000024:0.0:1789120671.998449:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120671.999413:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922278016:12345-0@lo:13: Request processed in 989us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120671.999423:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789120671.999470:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd832b9680 x1876028922278016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120671.999961:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922278016:0@lo:13: 00000001:02000400:3.0:1789120672.020641:0:7072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1789120672.561836:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789120673.005272:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120674.026788:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120675.050632:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120676.075122:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120677.099349:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120677.099901:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922278144:0@lo:400: 00000100:00100000:2.0:1789120677.099987:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120677.100055:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120677.100063:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922278528:0@lo:400: 00000100:00100000:2.0:1789120677.100098:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120677.100132:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922278272:0@lo:400: 00000100:00100000:2.0:1789120677.100201:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120677.100225:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120677.100230:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922278400:0@lo:400: 00000100:00100000:2.0:1789120677.100324:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120677.100364:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278144 00000100:00100000:2.0:1789120677.100374:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278144 00000100:00100000:2.0:1789120677.100429:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789120677.100439:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3318:x1876028922278144:12345-0@lo:400: 00000100:00100000:2.0:1789120677.100494:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3318:x1876028922278144:12345-0@lo:400: Request processed in 57us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120677.100512:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789120677.100550:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278528 00000100:00100000:2.0:1789120677.100554:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278528 00000100:00100000:2.0:1789120677.100593:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120677.100600:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922278528:12345-0@lo:400: 00000100:00100000:2.0:1789120677.100632:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922278528:12345-0@lo:400: Request processed in 33us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120677.100639:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120677.100657:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278272 00000100:00100000:2.0:1789120677.100661:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278272 00000100:00100000:2.0:1789120677.100686:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278400 00000100:00100000:2.0:1789120677.100688:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278400 00000100:00100000:2.0:1789120677.100704:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789120677.100722:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922278272:12345-0@lo:400: 00000100:00100000:2.0:1789120677.100757:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922278272:12345-0@lo:400: Request processed in 36us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120677.100763:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789120677.100774:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120677.100780:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922278400:12345-0@lo:400: 00000100:00100000:2.0:1789120677.100805:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922278400:12345-0@lo:400: Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120677.100811:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789120677.100832:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120677.100838:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120677.100872:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91f661c0 x1876028922278400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120677.100888:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922278400:0@lo:400: 00010000:00080000:2.0:1789120677.100909:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91f670c0 x1876028922278272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120677.100918:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922278272:0@lo:400: 00010000:00080000:2.0:1789120677.100954:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd91f67840 x1876028922278528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120677.100961:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789120677.100975:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922278528:0@lo:400: 00000100:00100000:2.0:1789120677.100985:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922278144:0@lo:400: 00000100:00100000:2.0:1789120677.101205:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120677.101216:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922278656:0@lo:13: 00000100:00100000:2.0:1789120677.101251:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120677.101416:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278656 00000100:00100000:3.0:1789120677.101422:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278656 00000100:00100000:3.0:1789120677.101459:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120677.101468:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922278656:12345-0@lo:13: 00002000:00000024:3.0:1789120677.101506:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120677.101560:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922278656:12345-0@lo:13: Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120677.101567:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789120677.101819:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffda31fed00 x1876028922278656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120677.101835:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922278656:0@lo:13: 00010000:00010000:2.0:1789120678.124358:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120679.153530:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120680.170443:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120681.194427:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120682.219460:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922278784:0@lo:400: 00000100:00100000:2.0:1789120682.219532:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.219590:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922279296:0@lo:13: 00000100:00100000:2.0:1789120682.219629:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.219655:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120682.219660:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922278912:0@lo:400: 00000100:00100000:2.0:1789120682.219815:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.219849:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922279040:0@lo:400: 00000100:00100000:2.0:1789120682.219885:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.219904:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120682.219909:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922279168:0@lo:400: 00000100:00100000:2.0:1789120682.219931:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.219963:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278784 00000100:00100000:2.0:1789120682.219970:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278784 00000100:00100000:2.0:1789120682.220012:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120682.220020:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3319:x1876028922278784:12345-0@lo:400: 00000100:00100000:2.0:1789120682.220065:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3319:x1876028922278784:12345-0@lo:400: Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.220072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120682.220103:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279296 00000100:00100000:2.0:1789120682.220106:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279296 00000100:00100000:2.0:1789120682.220137:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120682.220164:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922279296:12345-0@lo:13: 00002000:00000024:2.0:1789120682.220191:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120682.220223:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922279296:12345-0@lo:13: Request processed in 80us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.220861:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120682.220891:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922278912 00000100:00100000:2.0:1789120682.220895:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922278912 00000100:00100000:2.0:1789120682.220921:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279040 00000100:00100000:2.0:1789120682.220924:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279040 00000100:00100000:2.0:1789120682.220942:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120682.220948:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922278912:12345-0@lo:400: 00000100:00100000:2.0:1789120682.220987:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922278912:12345-0@lo:400: Request processed in 39us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.220993:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120682.221015:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789120682.221021:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922279040:12345-0@lo:400: 00000100:00100000:2.0:1789120682.221056:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922279040:12345-0@lo:400: Request processed in 34us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.221061:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789120682.221083:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120682.221087:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120682.221119:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5484780 x1876028922279040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.221132:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922279040:0@lo:400: 00010000:00080000:2.0:1789120682.221181:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5487480 x1876028922278912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.221192:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922278912:0@lo:400: 00000100:00100000:2.0:1789120682.221201:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922278784:0@lo:400: 00010000:00080000:2.0:1789120682.221211:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd832b92c0 x1876028922279296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.221223:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922279296:0@lo:13: 00010000:00010000:1.0:1789120682.221535:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120682.221560:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279168 00000100:00100000:1.0:1789120682.221565:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279168 00000100:00100000:1.0:1789120682.221613:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120682.221621:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922279168:12345-0@lo:400: 00000100:00100000:1.0:1789120682.221665:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922279168:12345-0@lo:400: Request processed in 46us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.221672:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789120682.222071:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb54843c0 x1876028922279168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.222081:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922279168:0@lo:400: 00000020:01000004:3.0:1789120682.433922:0:7634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789120682.433925:0:7634:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789120682.434056:0:7634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ffdbfb5a800 00000020:01000004:3.0:1789120682.434073:0:7634:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789120682.434085:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789120682.434105:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ffdb57bced8) 00000020:00000080:3.0:1789120682.434122:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789120682.465110:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789120682.465466:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789120682.486014:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789120682.490920:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789120682.490950:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789120682.491017:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789120682.491046:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789120682.491471:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789120682.491484:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789120682.491494:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x13cfa3d77faa4c0b 00000020:01000004:2.0:1789120682.491501:0:7634:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789120682.491522:0:7634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789120682.491525:0:7634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789120682.491531:0:7634:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789120682.491552:0:7634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789120682.491556:0:7634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789120682.506624:0:7634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789120682.506659:0:7634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.109@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789120682.506663:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789120682.506664:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789120682.506666:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120682.506667:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120682.506668:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120682.506670:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120682.506671:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120682.506673:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120682.506686:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120682.506688:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120682.506689:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120682.506694:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789120682.506696:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120682.506698:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789120682.506699:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120682.506700:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120682.506701:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120682.506701:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120682.506702:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120682.506703:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120682.506704:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120682.506705:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120682.506706:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120682.506740:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789120682.506758:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922279424:0@lo:253: 00000100:00100000:3.0:1789120682.506825:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.506933:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.507024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279424 00000100:00100000:2.0:1789120682.507031:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279424 00000100:00100000:2.0:1789120682.507123:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789120682.507133:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:7634:x1876028922279424:12345-0@lo:253: 20000000:01000000:2.0:1789120682.507183:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789120682.507187:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789120682.507192:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789120682.507195:0:5851:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789120682.508424:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120682.508641:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789120682.508654:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789120682.508704:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789120682.508712:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789120682.508743:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789120682.508794:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789120682.509181:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789120682.509202:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:2.0:1789120682.509204:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789120682.509323:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789120682.509339:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789120682.509391:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789120682.509399:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:2.0:1789120682.509430:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789120682.509440:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789120682.509471:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789120682.509523:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789120682.510385:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789120682.510405:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.109@tcp 20000000:01000000:2.0:1789120682.510407:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789120682.510441:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789120682.510449:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789120682.510477:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789120682.510484:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.109@tcp (null) (null) 00000040:00080000:2.0:1789120682.510512:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789120682.510520:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789120682.510564:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789120682.510619:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789120682.510636:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789120682.510639:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789120682.510644:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789120682.510646:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789120682.510648:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789120682.510660:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789120682.510662:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789120682.510710:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789120682.510712:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789120682.511329:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789120682.511581:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789120682.511621:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789120682.511708:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789120682.511721:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789120682.511723:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789120682.512122:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789120682.515023:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789120682.515130:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789120682.515643:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789120682.515703:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789120682.515775:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789120682.515942:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789120682.515956:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789120682.517112:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789120682.517393:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789120682.517453:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789120682.518570:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789120682.518619:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789120682.518658:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789120682.518673:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789120682.518753:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120682.520742:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120682.520851:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120682.520887:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789120682.523508:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789120682.523552:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789120682.523603:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1789120682.523619:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789120682.523637:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523653:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523672:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523749:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523757:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523763:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523771:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523898:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.523913:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.523927:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279552:0@lo:104: 00000100:00100000:3.0:1789120682.523986:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120682.524074:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524082:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 16 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.524090:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fe1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279680:0@lo:104: 00010000:00010000:3.0:1789120682.524118:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524126:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 16 pid: 5852 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.524133:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279808:0@lo:104: 00010000:00010000:3.0:1789120682.524179:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524186:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 16 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.524194:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279936:0@lo:104: 00010000:00010000:3.0:1789120682.524211:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524219:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 16 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.524235:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922280064:0@lo:104: 00000100:00100000:3.0:1789120682.524249:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.524409:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789120682.524426:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120682.524473:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120682.524516:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.524531:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279552 00000100:00100000:3.0:1789120682.524537:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279552 00000100:00100000:3.0:1789120682.524568:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279680 00000100:00100000:3.0:1789120682.524570:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279680 00000100:00100000:3.0:1789120682.524577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279808 00000100:00100000:3.0:1789120682.524579:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279808 00000100:00100000:3.0:1789120682.524590:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120682.524596:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdaa07c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:5851:x1876028922279552:12345-0@lo:104: 00010000:00010000:3.0:1789120682.524615:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524717:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120682.524723:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdaa07c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:5851:x1876028922279552:12345-0@lo:104: Request processed in 127us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.524731:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120682.524771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120682.524777:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5851:x1876028922279680:12345-0@lo:104: 00010000:00010000:3.0:1789120682.524795:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524824:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120682.524829:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5851:x1876028922279680:12345-0@lo:104: Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.524835:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120682.524847:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120682.524852:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5851:x1876028922279808:12345-0@lo:104: 00010000:00010000:3.0:1789120682.524859:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.524883:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789120682.524887:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5851:x1876028922279808:12345-0@lo:104: Request processed in 36us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.524892:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789120682.525069:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789120682.525076:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525084:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148bc00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120682.525088:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525096:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120682.525102:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120682.525107:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120682.525167:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525173:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120682.525192:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525199:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148bc00/0x13cfa3d77faa4bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bfd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525219:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120682.525222:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525239:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148a200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120682.525242:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525248:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120682.525254:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120682.525259:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120682.525273:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525279:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120682.525293:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525299:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a200/0x13cfa3d77faa4bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bd3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525307:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120682.525310:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525326:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149ae00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120682.525329:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525335:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120682.525341:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120682.525346:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120682.525360:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525366:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120682.525372:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525378:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525387:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120682.525388:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120682.525390:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120682.525404:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922280192:0@lo:103: 00000100:00100000:0.0:1789120682.525441:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.525488:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922280320:0@lo:103: 00000100:00100000:0.0:1789120682.525510:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.525536:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120682.525542:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922280448:0@lo:103: 00000100:00100000:0.0:1789120682.525564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.525592:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280192 00000100:00100000:0.0:1789120682.525597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280192 00010000:00010000:0.0:1789120682.525619:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 17 pid: 5851 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.525636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280320 00000100:00100000:0.0:1789120682.525639:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280320 00010000:00010000:0.0:1789120682.525650:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.525660:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280448 00000100:00100000:0.0:1789120682.525662:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280448 00010000:00010000:0.0:1789120682.525673:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 19 pid: 5852 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.525705:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120682.525712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922280192:12345-0@lo:103: 00010000:00010000:0.0:1789120682.525722:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.525727:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 19 pid: 5851 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525738:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 19 pid: 5851 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525754:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.525784:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922280192:12345-0@lo:103: Request processed in 72us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.525790:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120682.525812:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120682.525818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922280320:12345-0@lo:103: 00010000:00010000:0.0:1789120682.525825:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.525830:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525838:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525848:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.525876:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922280320:12345-0@lo:103: Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.525882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120682.525895:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120682.525901:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3317:x1876028922280448:12345-0@lo:103: 00010000:00010000:0.0:1789120682.525908:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.525912:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 17 pid: 5852 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525921:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 17 pid: 5852 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.525930:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.525950:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3317:x1876028922280448:12345-0@lo:103: Request processed in 50us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.525956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120682.525994:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922280192:0@lo:103: 00000100:00100000:0.0:1789120682.526021:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922280448:0@lo:103: 00000100:00100000:0.0:1789120682.526042:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922280320:0@lo:103: 00000100:00100000:1.0:1789120682.526426:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120682.526437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922279936 00000100:00100000:1.0:1789120682.526440:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922279936 00000100:00100000:1.0:1789120682.526459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280064 00000100:00100000:1.0:1789120682.526461:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280064 00000100:00100000:1.0:1789120682.526470:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120682.526476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5851:x1876028922279936:12345-0@lo:104: 00010000:00010000:1.0:1789120682.526485:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526524:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120682.526528:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:5851:x1876028922279936:12345-0@lo:104: Request processed in 54us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.526534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120682.526548:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120682.526555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5851:x1876028922280064:12345-0@lo:104: 00010000:00010000:1.0:1789120682.526562:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526586:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789120682.526590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5851:x1876028922280064:12345-0@lo:104: Request processed in 37us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.526605:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789120682.526622:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789120682.526627:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120682.526637:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526645:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120682.526652:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120682.526657:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120682.526750:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526757:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120682.526770:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526776:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390ae00/0x13cfa3d77faa4b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b8d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526800:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120682.526803:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526820:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148b600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120682.526823:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526830:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120682.526836:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120682.526841:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120682.526856:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526862:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120682.526868:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526874:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b600/0x13cfa3d77faa4b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b63 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.526887:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120682.526888:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120682.526890:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120682.526992:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922280576:0@lo:103: 00000100:00100000:0.0:1789120682.527027:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.527058:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120682.527063:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922280704:0@lo:103: 00000100:00100000:0.0:1789120682.527083:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.527110:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280576 00000100:00100000:0.0:1789120682.527114:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280576 00010000:00010000:0.0:1789120682.527132:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 17 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.527174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280704 00000100:00100000:0.0:1789120682.527177:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280704 00010000:00010000:0.0:1789120682.527189:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.527201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120682.527206:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3319:x1876028922280576:12345-0@lo:103: 00010000:00010000:0.0:1789120682.527214:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.527219:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527239:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 18 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527252:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.527277:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3319:x1876028922280576:12345-0@lo:103: Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.527283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120682.527303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120682.527309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3319:x1876028922280704:12345-0@lo:103: 00010000:00010000:0.0:1789120682.527315:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.527320:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 17 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527328:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 17 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527340:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527349:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527362:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527370:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527377:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527383:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527389:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120682.527393:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527400:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527415:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.527425:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.527448:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3319:x1876028922280704:12345-0@lo:103: Request processed in 139us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.527454:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120682.527489:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922280704:0@lo:103: 00000100:00100000:0.0:1789120682.527497:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922280576:0@lo:103: 00010000:00010000:0.0:1789120682.527514:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120682.528023:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4b600/0x13cfa3d77faa4bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4bf6 expref: 16 pid: 5851 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.528035:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279552:0@lo:104: 00010000:00010000:2.0:1789120682.528046:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148ba00/0x13cfa3d77faa4bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4bcc expref: 15 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.528054:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fe1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279680:0@lo:104: 00010000:00010000:2.0:1789120682.528063:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4bb0 expref: 14 pid: 5852 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.528072:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279808:0@lo:104: 00010000:00010000:2.0:1789120682.528080:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa4b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4b86 expref: 13 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.528088:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922279936:0@lo:104: 00010000:00010000:2.0:1789120682.528096:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4b5c expref: 12 pid: 5850 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.528105:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5851:1876028922280064:0@lo:104: 00010000:00010000:2.0:1789120682.528128:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.528472:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.528480:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.528487:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4c12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789120682.528501:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789120682.612494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:7634:x1876028922279424:12345-0@lo:253: Request processed in 105354us (105659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.612509:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120682.612816:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922279424:0@lo:253: 10000000:01000000:0.0:1789120682.612833:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789120682.612837:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120682.612838:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789120682.612840:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120682.612841:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789120682.612843:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120682.612844:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120682.612846:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120682.612848:0:7634:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789120682.612850:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120682.612851:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789120682.612873:0:7634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffdbfb5a800 from lustre-OST0001 10000000:01000000:0.0:1789120682.612899:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789120682.612902:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789120682.612910:0:7634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffd9cd18000 local copy 10000000:01000000:0.0:1789120682.612914:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120682.612951:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.612979:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.612988:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.613007:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922280832:0@lo:101: 00000100:00100000:0.0:1789120682.613045:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.613284:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.613987:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280832 00000100:00100000:2.0:1789120682.613996:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280832 00000100:00100000:2.0:1789120682.614092:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789120682.614102:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:7634:x1876028922280832:12345-0@lo:101: 00010000:00010000:2.0:1789120682.614117:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120682.614135:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c19 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.614178:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c19 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.614189:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c19 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.614199:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a800, rc 0) 00000100:00100000:2.0:1789120682.614377:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922280832:12345-0@lo:101: Request processed in 276us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.614397:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120682.614478:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922280832:0@lo:101: 00010000:00010000:0.0:1789120682.614494:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.614502:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.614610:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922280960:0@lo:501: 00000100:00100000:0.0:1789120682.614645:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.615123:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214540 going to sleep for 11 seconds 00000100:00100000:3.0:1789120682.615267:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922280960 00000100:00100000:3.0:1789120682.615274:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922280960 00000100:00100000:3.0:1789120682.615305:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789120682.615325:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922280960:12345-0@lo:501: 00000100:00100000:3.0:1789120682.615551:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922280960:12345-0@lo:501: Request processed in 228us (905us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789120682.615559:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120682.615916:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922280960:0@lo:501: 10000000:01000000:0.0:1789120682.615937:0:7634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789120682.615973:0:7634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789120682.615981:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.615991:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.616005:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.616032:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789120682.616055:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffdbfb5a800 10000000:01000000:0.0:1789120682.616060:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789120682.616065:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789120682.616068:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120682.616073:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789120682.616076:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789120682.616101:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.616109:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.616118:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.616135:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281088:0@lo:101: 00000100:00100000:0.0:1789120682.616190:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.616214:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214780 going to sleep for 11 seconds 00010000:00010000:3.0:1789120682.616463:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120682.616470:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616477:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120682.616481:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616490:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120682.616497:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120682.616503:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120682.616524:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616531:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120682.616555:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616562:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa4c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x13cfa3d77faa4c20 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616574:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120682.616581:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120682.616583:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120682.616591:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120682.616602:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922281216:0@lo:103: 00000100:00100000:3.0:1789120682.616634:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.616668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281216 00000100:00100000:3.0:1789120682.616673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281216 00000100:00100000:3.0:1789120682.616931:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120682.616940:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:3318:x1876028922281216:12345-0@lo:103: 00010000:00010000:3.0:1789120682.616951:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120682.616964:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149a800/0x13cfa3d77faa4c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4c19 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.616978:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120682.617011:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:3318:x1876028922281216:12345-0@lo:103: Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.617018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120682.617045:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922281216:0@lo:103: 00000100:00100000:3.0:1789120682.617061:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281088 00000100:00100000:3.0:1789120682.617064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281088 00000100:00100000:3.0:1789120682.617080:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789120682.617086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+11:7634:x1876028922281088:12345-0@lo:101: 00010000:00010000:3.0:1789120682.617095:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120682.617108:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c27 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.617125:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.617180:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.617188:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:3.0:1789120682.617386:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281088:12345-0@lo:101: Request processed in 134us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.617394:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789120682.617445:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281088:0@lo:101: 00010000:00010000:3.0:1789120682.617459:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.617468:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120682.617554:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281344:0@lo:501: 00000100:00100000:3.0:1789120682.617581:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.617746:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.618027:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281344 00000100:00100000:2.0:1789120682.618032:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281344 00000100:00100000:2.0:1789120682.618058:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789120682.618066:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281344:12345-0@lo:501: 00000100:00100000:2.0:1789120682.618318:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281344:12345-0@lo:501: Request processed in 252us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.618326:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789120682.618482:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281344:0@lo:501: 00000100:00100000:3.0:1789120682.618515:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281472:0@lo:503: 00000100:00100000:3.0:1789120682.618556:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.618588:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.618709:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281472 00000100:00100000:2.0:1789120682.618714:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281472 00000100:00100000:2.0:1789120682.618735:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789120682.618742:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281472:12345-0@lo:503: 00000100:00100000:2.0:1789120682.619095:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281472:12345-0@lo:503: Request processed in 352us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.619102:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789120682.619216:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281472:0@lo:503: 00000040:00080000:3.0:1789120682.619475:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120682.619541:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281600:0@lo:502: 00000100:00100000:3.0:1789120682.619582:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.619614:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.619956:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281600 00000100:00100000:2.0:1789120682.619962:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281600 00000100:00100000:2.0:1789120682.619985:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789120682.619991:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281600:12345-0@lo:502: 00000100:00100000:2.0:1789120682.620173:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281600:12345-0@lo:502: Request processed in 180us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.620180:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120682.620383:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281600:0@lo:502: 00000040:00080000:3.0:1789120682.620648:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789120682.621118:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789120682.621399:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789120682.621457:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789120682.621495:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789120682.621530:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789120682.621576:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281728:0@lo:502: 00000100:00100000:2.0:1789120682.621628:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.622274:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120682.622387:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281728 00000100:00100000:0.0:1789120682.622394:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281728 00000100:00100000:3.0:1789120682.622506:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789120682.622515:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281728:12345-0@lo:502: 00000100:00100000:3.0:1789120682.622723:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281728:12345-0@lo:502: Request processed in 208us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.622730:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789120682.622952:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281728:0@lo:502: 00000040:00080000:0.0:1789120682.623065:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789120682.623077:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789120682.623665:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120682.623693:0:7642:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789120682.623700:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120682.623702:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789120682.623709:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120682.623723:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ffd9cd1ced8) 00000020:00000080:0.0:1789120682.623744:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789120682.623749:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789120682.623978:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdbfb5a800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789120682.623986:0:7642:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789120682.623997:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x13cfa3d77faa4c3c 00010000:00010000:1.0:1789120682.641874:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789120682.644531:0:7642:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789120682.654777:0:7642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789120682.655058:0:7642:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789120682.673489:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789120682.674507:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789120682.690878:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789120682.690902:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120682.690909:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120682.690911:0:7642:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789120682.690915:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120682.690919:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120682.690920:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789120682.690923:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120682.690924:0:7642:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789120682.690971:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120682.690975:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120682.690976:0:7642:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789120682.690979:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789120682.701788:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789120682.701830:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789120682.701911:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.701924:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120682.701933:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdbfb5a800 from 1 10000000:01000000:2.0:1789120682.701936:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120682.701973:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.701981:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.701992:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.702016:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281856:0@lo:101: 00000100:00100000:2.0:1789120682.702082:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.702140:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.702941:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281856 00000100:00100000:1.0:1789120682.702950:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281856 00000100:00100000:1.0:1789120682.702995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789120682.703006:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:7634:x1876028922281856:12345-0@lo:101: 00010000:00010000:1.0:1789120682.703020:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120682.703035:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c43 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.703075:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.703085:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.703095:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690400, rc 0) 00000100:00100000:1.0:1789120682.703162:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922281856:12345-0@lo:101: Request processed in 138us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.703171:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120682.703640:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281856:0@lo:101: 00010000:00010000:2.0:1789120682.703658:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.703854:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.703971:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281984:0@lo:501: 00000100:00100000:2.0:1789120682.704009:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.704053:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.705819:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922281984 00000100:00100000:1.0:1789120682.705840:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922281984 00000100:00100000:1.0:1789120682.705886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789120682.705895:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922281984:12345-0@lo:501: 00000100:00100000:1.0:1789120682.706164:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922281984:12345-0@lo:501: Request processed in 269us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.706172:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789120682.710856:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922281984:0@lo:501: 00000100:00100000:2.0:1789120682.710919:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282112:0@lo:503: 00000100:00100000:2.0:1789120682.710999:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.711052:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282112 00000100:00100000:2.0:1789120682.711058:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120682.711060:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282112 00000100:00100000:3.0:1789120682.711206:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120682.711764:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282112:12345-0@lo:503: 00000100:00100000:2.0:1789120682.712122:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282112:12345-0@lo:503: Request processed in 906us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.712131:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789120682.713431:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282112:0@lo:503: 00000040:00080000:3.0:1789120682.713825:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120682.713899:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282240:0@lo:502: 00000100:00100000:3.0:1789120682.713964:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.714014:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.714824:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282240 00000100:00100000:2.0:1789120682.714833:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282240 00000100:00100000:2.0:1789120682.714888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789120682.714899:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282240:12345-0@lo:502: 00000100:00100000:2.0:1789120682.715134:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282240:12345-0@lo:502: Request processed in 237us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.716367:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789120682.716524:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282240:0@lo:502: 00000040:00080000:3.0:1789120682.716958:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789120682.717015:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789120682.717051:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282368:0@lo:502: 00000100:00100000:3.0:1789120682.717106:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120682.717173:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120682.717760:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282368 00000100:00100000:2.0:1789120682.717768:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282368 00000100:00100000:2.0:1789120682.717833:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120682.717843:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282368:12345-0@lo:502: 00000100:00100000:2.0:1789120682.718048:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282368:12345-0@lo:502: Request processed in 205us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.718056:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789120682.719939:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282368:0@lo:502: 00000040:00080000:3.0:1789120682.720103:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789120682.720118:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789120682.725049:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120682.725075:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120682.725078:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789120682.725086:0:7646:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdbfb5a800 00000020:00000080:3.0:1789120682.725089:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120682.725115:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120682.725119:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120682.725120:0:7646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789120682.725123:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789120682.725428:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789120682.725453:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120682.725478:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.725489:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120682.725534:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789120682.725537:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffdbfb5a800 10000000:01000000:2.0:1789120682.725540:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffdbfb5a800 10000000:01000000:2.0:1789120682.725544:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120682.725549:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdbfb5a800 from 1 10000000:01000000:2.0:1789120682.725552:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120682.725587:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.725595:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.725605:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.725625:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282496:0@lo:101: 00000100:00100000:2.0:1789120682.725703:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.725750:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf5013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.725890:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282496 00000100:00100000:1.0:1789120682.725896:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282496 00000100:00100000:1.0:1789120682.725946:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789120682.725956:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922282496:12345-0@lo:101: 00010000:00010000:1.0:1789120682.725970:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120682.725982:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c51 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.726005:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.726016:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.726025:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691e00, rc 0) 00000100:00100000:1.0:1789120682.726063:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282496:12345-0@lo:101: Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.726070:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789120682.726372:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282496:0@lo:101: 00010000:00010000:2.0:1789120682.726387:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120682.726396:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120682.726481:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282624:0@lo:501: 00000100:00100000:2.0:1789120682.726510:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.726662:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf5013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.732919:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282624 00000100:00100000:1.0:1789120682.732934:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282624 00000100:00100000:1.0:1789120682.733001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789120682.733012:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282624:12345-0@lo:501: 00000100:00100000:1.0:1789120682.733539:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282624:12345-0@lo:501: Request processed in 529us (7027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.733555:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789120682.733648:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282624:0@lo:501: 00000100:00100000:2.0:1789120682.733714:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282752:0@lo:503: 00000100:00100000:2.0:1789120682.733761:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.733814:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf5013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120682.734028:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282752 00000100:00100000:3.0:1789120682.734034:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282752 00000100:00100000:0.0:1789120682.734396:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789120682.734404:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282752:12345-0@lo:503: 00000100:00100000:0.0:1789120682.734565:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282752:12345-0@lo:503: Request processed in 161us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.734572:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789120682.734668:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282752:0@lo:503: 00000040:00080000:2.0:1789120682.734954:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789120682.735035:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282880:0@lo:502: 00000100:00100000:2.0:1789120682.735076:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.735112:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf5013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120682.735400:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922282880 00000100:00100000:0.0:1789120682.735406:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922282880 00000100:00100000:0.0:1789120682.735439:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789120682.735448:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282880:12345-0@lo:502: 00000100:00100000:0.0:1789120682.735618:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922282880:12345-0@lo:502: Request processed in 171us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.735626:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789120682.736525:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922282880:0@lo:502: 00000040:00080000:2.0:1789120682.736987:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789120682.737044:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789120682.737080:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789120682.739570:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789120682.740799:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789120682.740928:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789120682.740972:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789120682.741021:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789120682.741071:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789120682.741110:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789120682.742921:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789120682.743018:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789120682.743048:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789120682.743078:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789120682.744909:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789120682.744999:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789120682.745036:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789120682.745113:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789120682.746412:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789120682.746481:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789120682.746551:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789120682.746590:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789120682.746626:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789120682.747769:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789120682.747931:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789120682.747966:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789120682.748021:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789120682.748058:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789120682.748091:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789120682.749621:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789120682.751242:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789120682.751295:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789120682.751332:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789120682.751401:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789120682.751440:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789120682.751486:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789120682.751520:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789120682.751570:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922283008:0@lo:502: 00000100:00100000:2.0:1789120682.751654:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.751717:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf5013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120682.751813:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283008 00000100:00100000:0.0:1789120682.751821:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283008 00000100:00100000:0.0:1789120682.751870:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789120682.751879:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922283008:12345-0@lo:502: 00000100:00100000:0.0:1789120682.752095:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922283008:12345-0@lo:502: Request processed in 216us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.752103:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789120682.752886:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922283008:0@lo:502: 00000040:00080000:2.0:1789120682.752976:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789120682.752990:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789120682.754535:0:7647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789120682.754564:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ffc812cb490) 00000020:00000080:2.0:1789120682.754585:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789120682.754653:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdbfb5a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789120682.754657:0:7647:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffdbfb5a800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789120682.754660:0:7647:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdbfb5a800 3 00010000:00080000:2.0:1789120682.754699:0:7647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffdb590b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789120682.756917:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789120682.757386:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789120682.757426:0:7647:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789120682.757435:0:7647:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x13cfa3d77faa4c66 00000100:00080000:2.0:1789120682.757444:0:7647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120682.757450:0:7647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ffdb590b800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120682.757484:0:7647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb5487480 x1876028922283136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120682.757541:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922283136:0@lo:38: 00000100:00100000:3.0:1789120682.757611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789120682.757694:0:7647:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789120682.757843:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283136 00000100:00100000:0.0:1789120682.757850:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283136 00000100:00100000:0.0:1789120682.757887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120682.757895:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922283136:12345-0@lo:38: 00010000:00080000:0.0:1789120682.757919:0:5857:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:0.0:1789120682.757951:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x13cfa3d77faa4c6d 00000004:00100000:0.0:1789120682.757966:0:5857:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789120682.757997:0:5857:0:(import.c:65:import_set_state_nolock()) ffff9ffda0a4d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120682.770567:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876028922283136:12345-0@lo:38: Request processed in 12661us (12945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.770583:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120682.771529:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922283392:0@lo:400: 00000100:00100000:2.0:1789120682.771589:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.771624:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120682.771630:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922283520:0@lo:400: 00000100:00100000:2.0:1789120682.771655:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.771705:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283392 00000100:00100000:2.0:1789120682.771712:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283392 00000100:00100000:2.0:1789120682.771755:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120682.771777:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922283392:12345-0@lo:400: 00000100:00100000:2.0:1789120682.771838:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922283392:12345-0@lo:400: Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.771845:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120682.771867:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283520 00000100:00100000:2.0:1789120682.771870:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283520 00000100:00100000:2.0:1789120682.771897:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120682.771903:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922283520:12345-0@lo:400: 00000100:00100000:2.0:1789120682.771931:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922283520:12345-0@lo:400: Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.771937:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120682.771953:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120682.771961:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922283264:0@lo:400: 00000100:00100000:2.0:1789120682.771985:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120682.772012:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283264 00000100:00100000:2.0:1789120682.772015:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283264 00000100:00100000:2.0:1789120682.772035:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120682.772040:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922283264:12345-0@lo:400: 00000100:00100000:2.0:1789120682.772070:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922283264:12345-0@lo:400: Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120682.772076:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789120682.772104:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5484780 x1876028922283264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.772117:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922283264:0@lo:400: 00010000:00080000:2.0:1789120682.772139:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5486d00 x1876028922283520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.772178:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922283520:0@lo:400: 00010000:00080000:2.0:1789120682.772190:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5487c00 x1876028922283392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120682.772198:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922283392:0@lo:400: 00010000:00080000:3.0:1789120682.782297:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb5487480 x1876028922283136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120682.782313:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120682.782323:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789120682.782332:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789120682.782337:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120682.782341:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdb590b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120682.782348:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922283136:0@lo:38: 00000040:00080000:2.0:1789120682.783810:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789120682.784193:0:7648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1876028922283648:0@lo:901: 00000100:00100000:1.0:1789120682.784297:0:7648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789120682.790352:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789120682.790392:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120682.790461:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.790475:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789120682.790557:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789120682.790559:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789120682.790561:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120682.790562:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120682.790564:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120682.790565:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120682.790567:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120682.790569:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120682.790570:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120682.790572:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120682.790574:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120682.790578:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789120682.790581:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120682.790588:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789120682.790589:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120682.790590:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120682.790591:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120682.790591:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120682.790592:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120682.790593:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120682.790594:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120682.790595:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120682.790595:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120682.790624:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789120682.790642:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922283776:0@lo:253: 00000100:00100000:0.0:1789120682.790885:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.790933:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.793520:0:7648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120682.793574:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283648 00000100:00100000:1.0:1789120682.793583:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283648 00000100:00100000:1.0:1789120682.793640:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120682.793648:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1876028922283648:12345-0@lo:901: 00000100:00100000:1.0:1789120682.794024:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1876028922283648:12345-0@lo:901: Request processed in 376us (9727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120682.794031:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789120682.794069:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffd832ba1c0 x1876028922283648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789120698 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120682.794083:0:7648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1876028922283648:0@lo:901: 00000100:00100000:2.0:1789120682.795423:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283776 00000100:00100000:2.0:1789120682.795432:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283776 00000100:00100000:2.0:1789120682.795476:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789120682.795485:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7634:x1876028922283776:12345-0@lo:253: 20000000:01000000:2.0:1789120682.795514:0:5851:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789120682.795528:0:5851:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1789120682.795941:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1789120682.882411:0:5851:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789120682.882431:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789120682.883628:0:5873:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789120682.883636:0:5873:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789120682.883658:0:5873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.883691:0:5873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.883700:0:5873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.883740:0:5873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.883771:0:5873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120682.883927:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922283904:0@lo:104: 00000100:00100000:1.0:1789120682.884006:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120682.884068:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120682.884179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922283904 00000100:00100000:3.0:1789120682.884187:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922283904 00000100:00100000:3.0:1789120682.884250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789120682.884260:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922283904:12345-0@lo:104: 00010000:00010000:3.0:1789120682.884273:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120682.884325:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120682.884330:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:5873:x1876028922283904:12345-0@lo:104: Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.884344:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789120682.884916:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120682.884924:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.884933:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148be00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120682.884937:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.884946:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120682.884953:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120682.884959:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120682.884999:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.885006:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120682.885031:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.885045:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148be00/0x13cfa3d77faa4bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4bc5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.885062:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120682.885064:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120682.885065:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120682.885073:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120682.885087:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922284032:0@lo:103: 00000100:00100000:0.0:1789120682.885126:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120682.885204:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284032 00000100:00100000:0.0:1789120682.885210:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284032 00010000:00010000:0.0:1789120682.885902:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 15 pid: 5851 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.885939:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120682.885949:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdaa248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:3318:x1876028922284032:12345-0@lo:103: 00010000:00010000:0.0:1789120682.885961:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120682.885966:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 15 pid: 5851 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.885976:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 15 pid: 5851 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.885994:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886001:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789120682.886027:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002392128s 00010000:00010000:0.0:1789120682.886032:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886039:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886045:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886051:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886057:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120682.886060:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886068:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886077:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120682.886085:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120682.886129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdaa248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:3318:x1876028922284032:12345-0@lo:103: Request processed in 181us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120682.886136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789120682.886497:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148aa00/0x13cfa3d77faa4bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4bbe expref: 14 pid: 5851 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120682.886510:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832ba1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5873:1876028922283904:0@lo:104: 00010000:00010000:1.0:1789120682.886531:0:5873:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.886540:0:5873:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.886547:0:5873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120682.886553:0:5873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4c74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120682.887369:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922284032:0@lo:103: 00000100:00100000:0.0:1789120682.901923:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71bf207b-8b16-4d55-83e2-f8c047f616c0:7634:1876028922283776:0@lo:253: 10000000:01000000:0.0:1789120682.901954:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789120682.901958:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120682.901960:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789120682.901962:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120682.901963:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120682.901964:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120682.901966:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120682.901967:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120682.901969:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120682.901970:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120682.901972:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120682.901974:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789120682.901992:0:7634:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789120682.902789:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:7634:x1876028922283776:12345-0@lo:253: Request processed in 107291us (111890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120682.902802:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00080000:10000000:1.0:1789120682.910007:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120682.910197:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789120682.911796:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120682.911968:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789120682.914460:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120682.914843:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789120682.916664:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789120683.251552:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789120683.283185:0:7634:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789120683.283192:0:7634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789120683.283376:0:7634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789120683.283427:0:7634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789120683.283439:0:7634:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789120683.283462:0:7634:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789120684.267523:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120685.295115:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120686.316220:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120687.339231:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120687.340422:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922284160:0@lo:13: 00000100:00100000:2.0:1789120687.340510:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120687.340961:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284160 00000100:00100000:1.0:1789120687.340969:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284160 00000100:00080000:2.0:1789120687.341001:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120687.341027:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120687.341037:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922284160:12345-0@lo:13: 00002000:00000024:1.0:1789120687.341747:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120687.341816:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5487c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922284160:12345-0@lo:13: Request processed in 780us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120687.341825:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789120687.341994:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5904f00 x1876028922284160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120687.342015:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5904f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922284160:0@lo:13: 00000100:00100000:2.0:1789120687.850503:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922284672:0@lo:400: 00000100:00100000:2.0:1789120687.850571:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120687.850674:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120687.850694:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922284544:0@lo:400: 00000100:00100000:2.0:1789120687.850724:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120687.850771:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284672 00000100:00100000:2.0:1789120687.850778:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284672 00000100:00100000:2.0:1789120687.850825:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120687.850835:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922284672:12345-0@lo:400: 00000100:00100000:2.0:1789120687.850894:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922284672:12345-0@lo:400: Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120687.850901:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120687.850925:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284544 00000100:00100000:2.0:1789120687.850928:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284544 00000100:00100000:2.0:1789120687.850957:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120687.850963:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922284544:12345-0@lo:400: 00000100:00100000:2.0:1789120687.850992:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922284544:12345-0@lo:400: Request processed in 30us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120687.850998:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789120687.851017:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789120687.851045:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54843c0 x1876028922284544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120687.851058:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922284544:0@lo:400: 00010000:00080000:2.0:1789120687.851068:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5485e00 x1876028922284672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120687.851076:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922284672:0@lo:400: 00000100:00100000:3.0:1789120687.851169:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922284416:0@lo:400: 00000100:00100000:3.0:1789120687.851213:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120687.851241:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789120687.851247:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922284288:0@lo:400: 00000100:00100000:3.0:1789120687.851275:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120687.851299:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922284800:0@lo:400: 00000100:00100000:3.0:1789120687.851320:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120687.851344:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284416 00000100:00100000:3.0:1789120687.851348:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284416 00000100:00100000:3.0:1789120687.851372:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284800 00000100:00100000:3.0:1789120687.851375:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284800 00000100:00100000:3.0:1789120687.851396:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120687.851401:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922284416:12345-0@lo:400: 00000100:00100000:3.0:1789120687.851436:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922284416:12345-0@lo:400: Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120687.851442:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120687.851454:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789120687.851460:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922284800:12345-0@lo:400: 00000100:00100000:3.0:1789120687.851484:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922284800:12345-0@lo:400: Request processed in 24us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120687.851497:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789120687.851514:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120687.851530:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54852c0 x1876028922284800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120687.851540:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922284800:0@lo:400: 00010000:00080000:3.0:1789120687.851549:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5484780 x1876028922284416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120687.851556:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922284416:0@lo:400: 00000100:00100000:1.0:1789120687.852356:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284288 00000100:00100000:1.0:1789120687.852362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284288 00000100:00100000:1.0:1789120687.852409:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120687.852417:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3320:x1876028922284288:12345-0@lo:400: 00000100:00100000:1.0:1789120687.852466:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:3320:x1876028922284288:12345-0@lo:400: Request processed in 50us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120687.852473:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120687.852511:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922284288:0@lo:400: 00010000:00010000:2.0:1789120688.364040:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789120688.364224:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789120688.364229:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdaf537000 from 30 10000000:01000000:3.0:1789120688.364234:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120688.364294:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.364305:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.364316:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120688.364339:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922284928:0@lo:101: 00000100:00100000:3.0:1789120688.364420:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.364476:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.364845:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922284928 00000100:00100000:1.0:1789120688.364852:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922284928 00000100:00100000:1.0:1789120688.364895:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789120688.364905:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922284928:12345-0@lo:101: 00010000:00010000:1.0:1789120688.364918:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120688.364929:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120688.364967:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120688.364977:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120688.364986:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690e00, rc 0) 00000100:00100000:1.0:1789120688.365044:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922284928:12345-0@lo:101: Request processed in 140us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.365051:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789120688.365354:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922284928:0@lo:101: 00010000:00010000:3.0:1789120688.365369:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.365390:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.365696:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285056:0@lo:501: 00000100:00100000:2.0:1789120688.365900:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.365992:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.380430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285056 00000100:00100000:1.0:1789120688.380445:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285056 00000100:00100000:1.0:1789120688.380503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789120688.380512:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922285056:12345-0@lo:501: 00000100:00100000:1.0:1789120688.381881:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922285056:12345-0@lo:501: Request processed in 1365us (16146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.381892:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789120688.385514:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285056:0@lo:501: 00000100:00100000:2.0:1789120688.385577:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285184:0@lo:503: 00000100:00100000:2.0:1789120688.385662:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.385704:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.385940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285184 00000100:00100000:1.0:1789120688.385946:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285184 00000100:00100000:1.0:1789120688.385986:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789120688.385993:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922285184:12345-0@lo:503: 00000100:00100000:1.0:1789120688.386212:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922285184:12345-0@lo:503: Request processed in 218us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.386220:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789120688.386549:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285184:0@lo:503: 00000100:00100000:2.0:1789120688.387704:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7852:1876028922285312:0@lo:502: 00000100:00100000:2.0:1789120688.387978:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.388018:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.388068:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285312 00000100:00100000:1.0:1789120688.388074:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285312 00000100:00100000:1.0:1789120688.388116:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789120688.388131:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7852:x1876028922285312:12345-0@lo:502: 00000100:00100000:1.0:1789120688.388588:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7852:x1876028922285312:12345-0@lo:502: Request processed in 457us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.388595:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789120688.389496:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7852:1876028922285312:0@lo:502: 00000100:00100000:3.0:1789120688.389564:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7852:1876028922285440:0@lo:502: 00000100:00100000:3.0:1789120688.389619:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.389657:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285440 00000100:00100000:3.0:1789120688.389662:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285440 00000100:00100000:3.0:1789120688.389692:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789120688.389699:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7852:x1876028922285440:12345-0@lo:502: 00000100:00100000:3.0:1789120688.390059:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:7852:x1876028922285440:12345-0@lo:502: Request processed in 359us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.390066:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789120688.390107:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.390118:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7852:1876028922285440:0@lo:502: 00000040:00080000:3.0:1789120688.390139:0:7852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789120688.392213:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789120688.392240:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789120688.392249:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.392261:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120688.392269:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789120688.392272:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789120688.392275:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789120688.392308:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.392315:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.392324:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.392354:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285568:0@lo:101: 00000100:00100000:2.0:1789120688.392404:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.392442:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.393352:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285568 00000100:00100000:3.0:1789120688.393359:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285568 00000100:00100000:3.0:1789120688.393410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120688.393419:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922285568:12345-0@lo:101: 00010000:00010000:3.0:1789120688.393431:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120688.393444:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c89 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.393467:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.393484:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.393493:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a800, rc 0) 00000100:00100000:3.0:1789120688.393547:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922285568:12345-0@lo:101: Request processed in 130us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.393555:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120688.393594:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285568:0@lo:101: 00010000:00010000:3.0:1789120688.393619:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.393628:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120688.393690:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285696:0@lo:501: 00000100:00100000:3.0:1789120688.393715:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.393751:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.393771:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285696 00000100:00100000:3.0:1789120688.393774:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285696 00000100:00100000:3.0:1789120688.393794:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789120688.393800:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922285696:12345-0@lo:501: 00000100:00100000:3.0:1789120688.413511:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922285696:12345-0@lo:501: Request processed in 19703us (19788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.413533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789120688.413994:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285696:0@lo:501: 00000100:00100000:1.0:1789120688.414046:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285824:0@lo:503: 00000100:00100000:1.0:1789120688.414089:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120688.414132:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc83e7ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.417121:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285824 00000100:00100000:3.0:1789120688.417134:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285824 00000100:00100000:3.0:1789120688.417244:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120688.417254:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922285824:12345-0@lo:503: 00000100:00100000:3.0:1789120688.417654:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922285824:12345-0@lo:503: Request processed in 391us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.417662:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120688.417720:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922285824:0@lo:503: 00000100:00100000:3.0:1789120688.418205:0:7853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7853:1876028922285952:0@lo:502: 00000100:00100000:3.0:1789120688.418624:0:7853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.418704:0:7853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.427355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922285952 00000100:00100000:1.0:1789120688.427368:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922285952 00000100:00100000:1.0:1789120688.427420:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789120688.427429:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:7853:x1876028922285952:12345-0@lo:502: 00000100:00100000:1.0:1789120688.428059:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:7853:x1876028922285952:12345-0@lo:502: Request processed in 630us (9434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.428067:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789120688.428076:0:7853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7853:1876028922285952:0@lo:502: 00000020:01000000:0.0:1789120688.428109:0:7853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120688.428118:0:7853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120688.428120:0:7853:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789120688.428127:0:7853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789120688.428129:0:7853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789120688.428178:0:7853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7853:1876028922286080:0@lo:502: 00000100:00100000:0.0:1789120688.428220:0:7853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.428254:0:7853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120688.428306:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286080 00000100:00100000:2.0:1789120688.428310:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286080 00000100:00100000:2.0:1789120688.428345:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789120688.428369:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:7853:x1876028922286080:12345-0@lo:502: 00000100:00100000:2.0:1789120688.428511:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:7853:x1876028922286080:12345-0@lo:502: Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120688.428518:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789120688.428777:0:7853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7853:1876028922286080:0@lo:502: 00000020:01000000:0.0:1789120688.428798:0:7853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120688.428802:0:7853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120688.428804:0:7853:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789120688.428807:0:7853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789120688.428958:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789120688.428975:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789120688.428984:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.428995:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120688.429005:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789120688.429007:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd85287800 from 30 10000000:01000000:2.0:1789120688.429011:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120688.429034:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.429042:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.429050:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.429071:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286208:0@lo:101: 00000100:00100000:2.0:1789120688.429100:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.429123:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.433909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286208 00000100:00100000:3.0:1789120688.433922:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286208 00000100:00100000:3.0:1789120688.433984:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789120688.433995:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922286208:12345-0@lo:101: 00010000:00010000:3.0:1789120688.434010:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120688.434027:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4c97 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.434054:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.434065:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120688.434074:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120688.434181:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286208:12345-0@lo:101: Request processed in 187us (5078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.434188:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789120688.440923:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286208:0@lo:101: 00010000:00010000:2.0:1789120688.440952:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.440965:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.441042:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286336:0@lo:501: 00000100:00100000:2.0:1789120688.441099:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.441173:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.441293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286336 00000100:00100000:0.0:1789120688.441301:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286336 00000100:00100000:0.0:1789120688.441340:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789120688.441348:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286336:12345-0@lo:501: 00000100:00100000:0.0:1789120688.441616:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286336:12345-0@lo:501: Request processed in 266us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.441624:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789120688.441774:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286336:0@lo:501: 00000100:00100000:2.0:1789120688.441804:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286464:0@lo:503: 00000100:00100000:2.0:1789120688.441844:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.441877:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.441915:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286464 00000100:00100000:0.0:1789120688.441919:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286464 00000100:00100000:0.0:1789120688.441941:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789120688.441947:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286464:12345-0@lo:503: 00000100:00100000:0.0:1789120688.442085:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286464:12345-0@lo:503: Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.442093:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789120688.442187:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286464:0@lo:503: 00000100:00100000:0.0:1789120688.442786:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7858:1876028922286592:0@lo:502: 00000100:00100000:0.0:1789120688.442829:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.442852:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286592 00000100:00100000:0.0:1789120688.442855:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286592 00000100:00100000:0.0:1789120688.442880:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789120688.442887:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:7858:x1876028922286592:12345-0@lo:502: 00000100:00100000:0.0:1789120688.443054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:7858:x1876028922286592:12345-0@lo:502: Request processed in 166us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.443061:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789120688.443097:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf501780 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.443111:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7858:1876028922286592:0@lo:502: 00000100:00100000:0.0:1789120688.443185:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7858:1876028922286720:0@lo:502: 00000100:00100000:0.0:1789120688.443216:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.443234:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286720 00000100:00100000:0.0:1789120688.443237:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286720 00000100:00100000:0.0:1789120688.443257:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789120688.443270:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:7858:x1876028922286720:12345-0@lo:502: 00000100:00100000:0.0:1789120688.443384:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:7858:x1876028922286720:12345-0@lo:502: Request processed in 113us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.443390:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789120688.443417:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd89f65900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.443429:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7858:1876028922286720:0@lo:502: 00000040:00080000:0.0:1789120688.443447:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789120688.451268:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789120688.451302:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789120688.451312:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.451324:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120688.451348:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789120688.451351:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd85287800 from 5 10000000:01000000:2.0:1789120688.451354:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789120688.451389:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.451397:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.451408:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.451428:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286848:0@lo:101: 00000100:00100000:2.0:1789120688.451500:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.451548:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.451700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286848 00000100:00100000:0.0:1789120688.451707:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286848 00000100:00100000:0.0:1789120688.451753:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789120688.451761:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922286848:12345-0@lo:101: 00010000:00010000:0.0:1789120688.451773:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120688.451786:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b800/0x13cfa3d77faa4cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4ca5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.451807:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b800/0x13cfa3d77faa4cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ca5 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.451816:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b800/0x13cfa3d77faa4cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4ca5 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.451824:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b800, rc 0) 00000100:00100000:0.0:1789120688.451867:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922286848:12345-0@lo:101: Request processed in 107us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.451874:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120688.453732:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286848:0@lo:101: 00010000:00010000:2.0:1789120688.453757:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.453769:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.453843:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286976:0@lo:256: 00000100:00100000:2.0:1789120688.453895:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.453936:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.454028:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922286976 00000100:00100000:0.0:1789120688.454033:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922286976 00000100:00100000:0.0:1789120688.454076:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789120688.454091:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922286976:12345-0@lo:256: 20000000:01000000:0.0:1789120688.454109:0:5852:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789120688.454125:0:5852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789120688.454127:0:5852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789120688.454223:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922286976:12345-0@lo:256: Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.454231:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120688.454303:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922286976:0@lo:256: 10000000:01000000:2.0:1789120688.454342:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789120688.454353:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.454362:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120688.454370:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789120688.454373:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789120688.454376:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789120688.454400:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.454406:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.454414:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.454426:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287104:0@lo:101: 00000100:00100000:2.0:1789120688.454450:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.454540:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.457412:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287104 00000100:00100000:1.0:1789120688.457425:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287104 00000100:00100000:0.0:1789120688.457557:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789120688.457566:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922287104:12345-0@lo:101: 00010000:00010000:0.0:1789120688.457582:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120688.457599:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4cb3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.457623:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.457634:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.457651:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ba00, rc 0) 00000100:00100000:0.0:1789120688.457711:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287104:12345-0@lo:101: Request processed in 145us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.457717:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789120688.458085:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287104:0@lo:101: 00010000:00010000:2.0:1789120688.458102:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.458112:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.458210:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287232:0@lo:501: 00000100:00100000:2.0:1789120688.458258:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.458289:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120688.458601:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287232 00000100:00100000:1.0:1789120688.458607:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287232 00000100:00100000:1.0:1789120688.458654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789120688.458663:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287232:12345-0@lo:501: 00000100:00100000:1.0:1789120688.458912:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287232:12345-0@lo:501: Request processed in 250us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120688.458920:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789120688.458951:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287232:0@lo:501: 00000100:00100000:2.0:1789120688.458981:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287360:0@lo:503: 00000100:00100000:2.0:1789120688.459021:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.459040:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.459337:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287360 00000100:00100000:3.0:1789120688.459347:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287360 00000100:00100000:3.0:1789120688.459376:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789120688.459383:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287360:12345-0@lo:503: 00000100:00100000:3.0:1789120688.459618:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287360:12345-0@lo:503: Request processed in 234us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.459625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789120688.460722:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287360:0@lo:503: 00000100:00100000:0.0:1789120688.461742:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7861:1876028922287488:0@lo:502: 00000100:00100000:0.0:1789120688.461800:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.461845:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd89f65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120688.461945:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287488 00000100:00100000:2.0:1789120688.461951:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287488 00000100:00100000:2.0:1789120688.461993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789120688.462001:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:7861:x1876028922287488:12345-0@lo:502: 00000100:00100000:2.0:1789120688.462338:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:7861:x1876028922287488:12345-0@lo:502: Request processed in 336us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120688.462346:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789120688.473401:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7861:1876028922287488:0@lo:502: 00000020:01000000:2.0:1789120688.473447:0:7861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789120688.473454:0:7861:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789120688.473464:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120688.473466:0:7861:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789120688.473471:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789120688.473475:0:7861:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:2.0:1789120688.473498:0:7861:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789120688.473501:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789120688.473517:0:7861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ffc812cced8) 00000020:00000080:2.0:1789120688.473537:0:7861:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789120688.473543:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789120688.473635:0:7861:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789120688.473650:0:7861:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789120688.473663:0:7861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa4cc8 00010000:00080000:2.0:1789120688.473690:0:7861:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffda0b5e000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789120688.473942:0:7861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789120688.474708:0:7861:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789120688.474722:0:7861:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789120688.480435:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120688.480718:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120688.480796:0:7861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789120688.481137:0:7861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789120688.502271:0:7862:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120688.502279:0:7862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789120688.506583:0:7861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789120688.506598:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789120688.506637:0:7861:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789120688.506674:0:7861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa4ccf 00000100:00080000:2.0:1789120688.506685:0:7861:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120688.506691:0:7861:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffda0b5e000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120688.506729:0:7861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffd91f64000 x1876028922287616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120688.506755:0:7861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789120688.506800:0:7861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120688.506804:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120688.506806:0:7861:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789120688.506809:0:7861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120688.506813:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120688.506814:0:7861:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789120688.506816:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120688.506818:0:7861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789120688.506846:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7861:1876028922287744:0@lo:502: 00000100:00100000:2.0:1789120688.506920:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.506959:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120688.506992:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287744 00000100:00100000:2.0:1789120688.507003:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287744 00000100:00100000:2.0:1789120688.507041:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789120688.507050:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:7861:x1876028922287744:12345-0@lo:502: 00000100:00100000:3.0:1789120688.507088:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922287616:0@lo:8: 00000100:00100000:3.0:1789120688.507123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.507170:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287616 00000100:00100000:3.0:1789120688.507174:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287616 00000100:00100000:2.0:1789120688.507293:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:7861:x1876028922287744:12345-0@lo:502: Request processed in 243us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120688.507301:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789120688.507316:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120688.507322:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3316:x1876028922287616:12345-0@lo:8: 00010000:00080000:3.0:1789120688.507342:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000100:00100000:2.0:1789120688.507351:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:7861:1876028922287744:0@lo:502: 00000020:00000080:3.0:1789120688.507364:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa4cd6 00000020:01000000:2.0:1789120688.507373:0:7861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120688.507376:0:7861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00002000:00100000:3.0:1789120688.507377:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ffdb990b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 0 00000020:00000080:2.0:1789120688.507377:0:7861:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789120688.507380:0:7861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:3.0:1789120688.507381:0:6707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789120688.507384:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1789120688.507475:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00002000:00100000:3.0:1789120688.507484:0:6707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 10000000:01000000:2.0:1789120688.507492:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789120688.507500:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.507511:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120688.507521:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789120688.507523:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffd9cd18000 from 1 10000000:01000000:2.0:1789120688.507526:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789120688.507546:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.507554:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120688.507563:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120688.507585:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287872:0@lo:101: 00000100:00100000:2.0:1789120688.507612:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.507627:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120688.508251:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922287872 00000100:00100000:0.0:1789120688.508257:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922287872 00000100:00100000:0.0:1789120688.508290:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789120688.508298:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922287872:12345-0@lo:101: 00010000:00010000:0.0:1789120688.508308:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120688.508321:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4cdd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.508341:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.508351:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.508360:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ac00, rc 0) 00000100:00100000:0.0:1789120688.508405:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922287872:12345-0@lo:101: Request processed in 108us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.508411:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789120688.508476:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922287872:0@lo:101: 00010000:00010000:1.0:1789120688.508506:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120688.508514:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120688.508566:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922288000:0@lo:501: 00000100:00100000:1.0:1789120688.508591:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120688.508624:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc83e7c600 going to sleep for 11 seconds 00002000:00080000:3.0:1789120688.508701:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1789120688.508787:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288000 00000100:00100000:0.0:1789120688.508791:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288000 00000100:00100000:0.0:1789120688.508822:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120688.508829:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922288000:12345-0@lo:501: 00000100:00100000:0.0:1789120688.509023:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922288000:12345-0@lo:501: Request processed in 195us (430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120688.509030:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120688.509060:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922288000:0@lo:501: 10000000:01000000:0.0:1789120688.509085:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789120688.509092:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120688.509106:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789120688.509176:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120688.509342:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1876028922287616:12345-0@lo:8: Request processed in 2018us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.509350:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789120688.509367:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f64000 x1876028922287616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120688.509377:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789120688.509384:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789120688.509391:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789120688.509396:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789120688.509398:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffda0b5e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789120688.509419:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789120688.509424:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922287616:0@lo:8: 00000004:00080000:1.0:1789120688.509473:0:7862:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789120688.509595:0:7862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 155763450623ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789120688.633077:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789120688.704206:0:7865:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789120688.704240:0:7865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288256:0@lo:7: 00000100:00100000:3.0:1789120688.704323:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.704370:0:7865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.704383:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922288128:0@lo:13: 00000100:00100000:3.0:1789120688.704405:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120688.704439:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288256 00000100:00100000:3.0:1789120688.704445:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288256 00000100:00100000:3.0:1789120688.705662:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120688.705680:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1876028922288256:12345-0@lo:7: 00000100:00080000:0.0:1789120688.725001:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120688.725027:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288128 00000100:00100000:0.0:1789120688.725037:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288128 00000100:00100000:0.0:1789120688.725087:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120688.725096:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876028922288128:12345-0@lo:13: 00002000:00000024:0.0:1789120688.725130:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789120688.725279:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876028922288128:12345-0@lo:13: Request processed in 184us (20871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120688.725286:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789120688.727749:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffda31fde00 x1876028922288128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120688.727785:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922288128:0@lo:13: 00002000:00080000:3.0:1789120688.755340:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789120688.755348:0:6706:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789120688.755440:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1876028922288256:12345-0@lo:7: Request processed in 49760us (51114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120688.755452:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789120688.755638:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd989743c0 x1876028922288256/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120688.755663:0:7865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288256:0@lo:7: 00000004:00080000:0.0:1789120688.755675:0:7865:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789120688.755717:0:7865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288384:0@lo:5: 00000100:00100000:0.0:1789120688.755763:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.755804:0:7865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a26780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.756107:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288384 00000100:00100000:3.0:1789120688.756113:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288384 00000100:00100000:3.0:1789120688.756183:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120688.756203:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7865:x1876028922288384:12345-0@lo:5: 00002000:00080000:3.0:1789120688.756226:0:6707:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789120688.756230:0:6707:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789120688.756439:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7865:x1876028922288384:12345-0@lo:5: Request processed in 237us (675us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789120688.756447:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789120688.756473:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91e692c0 x1876028922288384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120688.756498:0:7865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288384:0@lo:5: 00000004:00080000:3.0:1789120688.756507:0:7865:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789120688.756530:0:7865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288512:0@lo:700: 00000100:00100000:3.0:1789120688.760630:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120688.761226:0:7865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120688.763371:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288512 00000100:00100000:2.0:1789120688.763382:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288512 00000100:00100000:2.0:1789120688.763438:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120688.763447:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7865:x1876028922288512:12345-0@lo:700: 00000100:00100000:2.0:1789120688.763502:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1876028922288640:0@lo:700: 00000100:00100000:2.0:1789120688.763572:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120688.763635:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfc25d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120688.763768:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288640 00000100:00100000:3.0:1789120688.763774:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288640 00000100:00100000:3.0:1789120688.763803:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120688.763809:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1876028922288640:12345-0@lo:700: 40000000:02000000:3.0:1789120688.825119:0:5864:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789120688.839587:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1876028922288640:12345-0@lo:700: Request processed in 75770us (76007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120688.839601:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789120688.841517:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f670c0 x1876028922288640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789120704 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120688.841534:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f670c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1876028922288640:0@lo:700: 40000000:02000000:3.0:1789120688.841548:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789120688.934083:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789120688.934100:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789120688.934274:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7865:x1876028922288512:12345-0@lo:700: Request processed in 170824us (173647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120688.934287:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789120688.934473:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b6a940 x1876028922288512/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120704 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120688.934484:0:7865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789120688.934499:0:7865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288512:0@lo:700: 00000004:02000040:0.0:1789120689.018114:0:7865:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789120689.024090:0:7865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288768:0@lo:5: 00000100:00100000:0.0:1789120689.024183:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120689.024245:0:7865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a26780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120689.027084:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288768 00000100:00100000:3.0:1789120689.027095:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288768 00000100:00100000:3.0:1789120689.027174:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120689.027197:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7865:x1876028922288768:12345-0@lo:5: 00002000:00080000:3.0:1789120689.040993:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789120689.041018:0:6706:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789120689.049176:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1876028922288768:12345-0@lo:5: Request processed in 21986us (24986us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120689.049254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789120689.049426:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91e692c0 x1876028922288768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120705 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120689.049445:0:7865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e692c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1876028922288768:0@lo:5: 00000004:00080000:1.0:1789120689.049460:0:7865:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789120689.387274:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120690.410355:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120691.434568:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120691.697418:0:7998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789120692.458360:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789120692.458360:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120692.458381:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922288896:0@lo:13: 00000100:00100000:2.0:1789120692.458456:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120692.458681:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922288896 00000100:00100000:1.0:1789120692.458688:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922288896 00000100:00100000:1.0:1789120692.458813:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120692.458823:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922288896:12345-0@lo:13: 00002000:00000024:1.0:1789120692.458854:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120692.458910:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922288896:12345-0@lo:13: Request processed in 89us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120692.458918:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789120692.458966:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5906940 x1876028922288896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120692.458984:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922288896:0@lo:13: 00000100:00080000:2.0:1789120692.459313:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789120693.494235:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120693.995886:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922289024:0@lo:400: 00000100:00100000:2.0:1789120693.995913:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922289280:0@lo:400: 00000100:00100000:3.0:1789120693.995954:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120693.995960:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120693.996104:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289280 00000100:00100000:2.0:1789120693.996111:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289280 00000100:00100000:2.0:1789120693.996242:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120693.996253:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922289280:12345-0@lo:400: 00000100:00100000:2.0:1789120693.996302:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922289280:12345-0@lo:400: Request processed in 51us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120693.996309:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789120693.996333:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120693.996559:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922289536:0@lo:400: 00000100:00100000:3.0:1789120693.996593:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120693.996646:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922289408:0@lo:400: 00000100:00100000:3.0:1789120693.996677:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120693.996699:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922289152:0@lo:400: 00000100:00100000:3.0:1789120693.996725:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789120693.996767:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b69e00 x1876028922289280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.996781:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922289280:0@lo:400: 00000100:00100000:3.0:1789120693.996800:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922289792:0@lo:13: 00000100:00100000:3.0:1789120693.996823:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120693.996860:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289536 00000100:00100000:3.0:1789120693.996865:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289536 00000100:00100000:3.0:1789120693.996898:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289152 00000100:00100000:3.0:1789120693.996902:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289152 00000100:00100000:3.0:1789120693.996921:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789120693.996930:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922289536:12345-0@lo:400: 00000100:00100000:3.0:1789120693.996973:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922289536:12345-0@lo:400: Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120693.996981:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789120693.996997:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120693.997003:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922289152:12345-0@lo:400: 00000100:00100000:3.0:1789120693.997041:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922289152:12345-0@lo:400: Request processed in 38us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120693.997047:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120693.997068:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289408 00000100:00100000:3.0:1789120693.997071:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289408 00000100:00100000:3.0:1789120693.997097:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120693.997105:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922289408:12345-0@lo:400: 00000100:00100000:3.0:1789120693.997165:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922289408:12345-0@lo:400: Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120693.997172:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120693.997191:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289792 00000100:00100000:3.0:1789120693.997197:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289792 00000100:00100000:3.0:1789120693.997229:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120693.997237:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876028922289792:12345-0@lo:13: 00002000:00000024:3.0:1789120693.997262:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120693.997301:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876028922289792:12345-0@lo:13: Request processed in 64us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120693.997309:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789120693.997328:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120693.997333:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120693.997366:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b6a1c0 x1876028922289152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.997376:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922289152:0@lo:400: 00000100:00100000:3.0:1789120693.997383:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922289664:0@lo:400: 00000100:00100000:3.0:1789120693.997412:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120693.997450:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289664 00000100:00100000:3.0:1789120693.997454:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289664 00000100:00100000:3.0:1789120693.997474:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120693.997483:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922289664:12345-0@lo:400: 00000100:00100000:3.0:1789120693.997523:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922289664:12345-0@lo:400: Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120693.997529:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789120693.997561:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b692c0 x1876028922289408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.997578:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922289408:0@lo:400: 00010000:00080000:3.0:1789120693.997609:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5905a40 x1876028922289792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.997642:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922289792:0@lo:13: 00010000:00080000:3.0:1789120693.997676:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b6b480 x1876028922289664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.997685:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922289664:0@lo:400: 00010000:00080000:3.0:1789120693.997712:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b6b840 x1876028922289536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120693.997721:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922289536:0@lo:400: 00000100:00100000:1.0:1789120693.998358:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289024 00000100:00100000:1.0:1789120693.998365:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289024 00000100:00100000:1.0:1789120693.998401:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789120693.998416:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922289024:12345-0@lo:400: 00000100:00100000:1.0:1789120693.998473:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922289024:12345-0@lo:400: Request processed in 59us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120693.998482:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789120693.998502:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922289024:0@lo:400: 00000001:00080000:2.0:1789120694.083330:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789120694.510174:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120695.531643:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120696.554695:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120696.974918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120696.974960:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294208 00000100:00100000:2.0:1789120696.974971:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294208 00000100:00100000:2.0:1789120696.975017:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:2.0:1789120696.975027:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1876028901294208:12345-192.168.206.9@tcp:250: 00010000:00080000:2.0:1789120696.975061:0:5851:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from e10de64a-96fd-4380-b3ad-f12a53725f77@192.168.206.9@tcp t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1789120696.975096:0:5851:0:(genops.c:1385:class_connect()) connect: client e10de64a-96fd-4380-b3ad-f12a53725f77, cookie 0x13cfa3d77faa4ceb 00000100:00080000:2.0:1789120696.975297:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9ffc83f22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120696.975383:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+5:2348:x1876028901294208:12345-192.168.206.9@tcp:250: Request processed in 356us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120696.975391:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:0.0:1789120696.986932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120696.987016:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294336 00000100:00100000:2.0:1789120696.987028:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294336 00000100:00100000:2.0:1789120696.987108:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:2.0:1789120696.987120:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+5:5577:x1876028901294336:12345-192.168.206.9@tcp:101: 00010000:00010000:2.0:1789120696.987178:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120696.987201:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac2b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120696.987235:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120696.987248:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120696.987259:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149ba00, rc 0) 00000100:00100000:2.0:1789120696.987325:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+6:5577:x1876028901294336:12345-192.168.206.9@tcp:101: Request processed in 206us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120696.987332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:1.0:1789120696.993418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120696.993472:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294464 00000100:00100000:1.0:1789120696.993485:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294464 00000100:00100000:1.0:1789120696.993547:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:1.0:1789120696.993559:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+6:5577:x1876028901294464:12345-192.168.206.9@tcp:501: 00000100:00100000:1.0:1789120696.993957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+6:5577:x1876028901294464:12345-192.168.206.9@tcp:501: Request processed in 397us (550us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120696.993967:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:0.0:1789120697.000087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.001493:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294592 00000100:00100000:1.0:1789120697.001510:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294592 00000100:00100000:1.0:1789120697.001575:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:1.0:1789120697.001587:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+6:5577:x1876028901294592:12345-192.168.206.9@tcp:101: 00010000:00010000:1.0:1789120697.001618:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120697.001640:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120697.001675:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120697.001689:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120697.001700:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690a00, rc 0) 00000100:00100000:1.0:1789120697.001792:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+7:5577:x1876028901294592:12345-192.168.206.9@tcp:101: Request processed in 207us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.001801:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:3.0:1789120697.007428:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.007545:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294720 00000100:00100000:1.0:1789120697.007558:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294720 00000100:00100000:1.0:1789120697.007627:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:1.0:1789120697.007639:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+7:5577:x1876028901294720:12345-192.168.206.9@tcp:501: 00000100:00100000:1.0:1789120697.009354:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5577:x1876028901294720:12345-192.168.206.9@tcp:501: Request processed in 1705us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.009369:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:1.0:1789120697.012294:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.012334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294848 00000100:00100000:1.0:1789120697.012345:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294848 00000100:00100000:1.0:1789120697.012401:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:1.0:1789120697.012413:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5577:x1876028901294848:12345-192.168.206.9@tcp:503: 00000100:00100000:1.0:1789120697.012896:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5577:x1876028901294848:12345-192.168.206.9@tcp:503: Request processed in 484us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.012904:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789120697.015913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.016208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901294976 00000100:00100000:1.0:1789120697.016222:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901294976 00000100:00100000:1.0:1789120697.016294:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:1.0:1789120697.016305:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5596:x1876028901294976:12345-192.168.206.9@tcp:502: 00000100:00100000:1.0:1789120697.016854:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5596:x1876028901294976:12345-192.168.206.9@tcp:502: Request processed in 547us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.016866:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:3.0:1789120697.040550:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120697.040649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295104 00000100:00100000:0.0:1789120697.040662:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295104 00000100:00100000:0.0:1789120697.040737:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:0.0:1789120697.040749:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5596:x1876028901295104:12345-192.168.206.9@tcp:502: 00000100:00100000:0.0:1789120697.041072:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5596:x1876028901295104:12345-192.168.206.9@tcp:502: Request processed in 325us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120697.041082:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:3.0:1789120697.048049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120697.048096:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295232 00000100:00100000:3.0:1789120697.048108:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295232 00000100:00100000:3.0:1789120697.048184:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789120697.048195:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5577:x1876028901295232:12345-192.168.206.9@tcp:101: 00010000:00010000:3.0:1789120697.048216:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120697.048237:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390b400/0x13cfa3d77faa4d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac5c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120697.048274:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390b400/0x13cfa3d77faa4d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac5c expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120697.048303:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390b400/0x13cfa3d77faa4d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac5c expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120697.048314:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b400, rc 0) 00000100:00100000:3.0:1789120697.048384:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5577:x1876028901295232:12345-192.168.206.9@tcp:101: Request processed in 191us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120697.048392:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:0.0:1789120697.057132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120697.057226:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295360 00000100:00100000:0.0:1789120697.057239:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295360 00000100:00100000:0.0:1789120697.057296:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:0.0:1789120697.057306:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5577:x1876028901295360:12345-192.168.206.9@tcp:256: 20000000:01000000:0.0:1789120697.057340:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789120697.057361:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789120697.057366:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789120697.057369:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789120697.057371:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789120697.060019:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5577:x1876028901295360:12345-192.168.206.9@tcp:256: Request processed in 2698us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.060044:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:1.0:1789120697.065024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120697.065112:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295488 00000100:00100000:0.0:1789120697.065125:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295488 00000100:00100000:0.0:1789120697.065323:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:0.0:1789120697.065337:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5577:x1876028901295488:12345-192.168.206.9@tcp:101: 00010000:00010000:0.0:1789120697.065360:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120697.065386:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac63 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120697.066057:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120697.066071:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120697.066082:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b000, rc 0) 00000100:00100000:0.0:1789120697.066867:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5577:x1876028901295488:12345-192.168.206.9@tcp:101: Request processed in 1527us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120697.066878:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:3.0:1789120697.072972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.073539:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295616 00000100:00100000:1.0:1789120697.073553:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295616 00000100:00100000:1.0:1789120697.073624:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:1.0:1789120697.073636:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5577:x1876028901295616:12345-192.168.206.9@tcp:501: 00000100:00100000:1.0:1789120697.073956:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5577:x1876028901295616:12345-192.168.206.9@tcp:501: Request processed in 321us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.073965:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:1.0:1789120697.076973:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120697.077065:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295744 00000100:00100000:2.0:1789120697.077077:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295744 00000100:00100000:2.0:1789120697.077180:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:2.0:1789120697.077193:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5577:x1876028901295744:12345-192.168.206.9@tcp:503: 00000100:00100000:2.0:1789120697.077617:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5577:x1876028901295744:12345-192.168.206.9@tcp:503: Request processed in 426us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120697.077626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:1.0:1789120697.087922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120697.088063:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901295872 00000100:00100000:3.0:1789120697.088076:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901295872 00000100:00100000:3.0:1789120697.088172:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:3.0:1789120697.088185:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5601:x1876028901295872:12345-192.168.206.9@tcp:502: 00000100:00100000:3.0:1789120697.088485:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5601:x1876028901295872:12345-192.168.206.9@tcp:502: Request processed in 302us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120697.088494:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:1.0:1789120697.094540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120697.094761:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296000 00000100:00100000:3.0:1789120697.094775:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296000 00000100:00100000:3.0:1789120697.094843:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:3.0:1789120697.094854:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5601:x1876028901296000:12345-192.168.206.9@tcp:502: 00000100:00100000:3.0:1789120697.095137:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5601:x1876028901296000:12345-192.168.206.9@tcp:502: Request processed in 283us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120697.095190:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:1.0:1789120697.098083:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120697.098134:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296128 00000100:00100000:1.0:1789120697.098173:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296128 00000100:00100000:1.0:1789120697.098228:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789120697.098238:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5906580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1876028901296128:12345-192.168.206.9@tcp:38: 00010000:00080000:1.0:1789120697.098273:0:5859:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1789120697.098335:0:5859:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa4d0e 00000004:00100000:1.0:1789120697.098374:0:5859:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789120697.098381:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789120697.145953:0:5859:0:(import.c:65:import_set_state_nolock()) ffff9ffdbfb5c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120697.146072:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5906580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901296128:12345-192.168.206.9@tcp:38: Request processed in 47833us (48000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120697.146087:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789120697.578801:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5904b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922289920:0@lo:13: 00000100:00100000:3.0:1789120697.578897:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120697.579179:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922289920 00000100:00100000:2.0:1789120697.579189:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922289920 00000100:00100000:2.0:1789120697.579264:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120697.579276:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922289920:12345-0@lo:13: 00002000:00000024:2.0:1789120697.579339:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120697.579389:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922289920:12345-0@lo:13: Request processed in 116us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120697.579397:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789120697.579565:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789120697.579653:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5904b40 x1876028922289920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120697.579676:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5904b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922289920:0@lo:13: 00010000:00010000:0.0:1789120697.582967:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120698.150078:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120698.150274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120698.150595:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296384 00000100:00100000:3.0:1789120698.150608:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296384 00000100:00100000:3.0:1789120698.150698:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296256 00000100:00080000:0.0:1789120698.150785:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120698.150865:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120698.150879:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296384:12345-192.168.206.9@tcp:41: 00000004:00000024:1.0:1789120698.150934:0:5859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789120698.151025:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296384:12345-192.168.206.9@tcp:41: Request processed in 149us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120698.151033:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:3.0:1789120698.151621:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296256 00000100:00100000:3.0:1789120698.151668:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:3.0:1789120698.151677:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:0:x1876028901296256:12345-192.168.206.9@tcp:41: 00000004:00000024:3.0:1789120698.151695:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789120698.151811:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:0:x1876028901296256:12345-192.168.206.9@tcp:41: Request processed in 135us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120698.151820:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120698.155784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120698.155874:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296512 00000100:00100000:3.0:1789120698.155885:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296512 00000100:00100000:3.0:1789120698.155945:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789120698.155955:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296512:12345-192.168.206.9@tcp:40: 00000100:00100000:3.0:1789120698.156054:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296512:12345-192.168.206.9@tcp:40: Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120698.156066:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789120698.160868:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120698.160969:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120698.161066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120698.161113:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120698.161420:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296896 00000100:00100000:2.0:1789120698.161431:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296896 00000100:00100000:2.0:1789120698.161511:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789120698.161522:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296896:12345-192.168.206.9@tcp:33: 00000100:00100000:0.0:1789120698.163119:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297024 00000100:00100000:0.0:1789120698.163134:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297024 00000100:00100000:0.0:1789120698.163247:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:0.0:1789120698.163258:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901297024:12345-192.168.206.9@tcp:400: 00000100:00100000:0.0:1789120698.163366:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901297024:12345-192.168.206.9@tcp:400: Request processed in 110us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120698.163383:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:3.0:1789120698.164331:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296640 00000100:00100000:3.0:1789120698.164341:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296640 00000100:00100000:3.0:1789120698.164394:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901296768 00000100:00100000:3.0:1789120698.165085:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901296768 00000100:00100000:3.0:1789120698.165121:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789120698.165129:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901296640:12345-192.168.206.9@tcp:8: 00010000:00080000:3.0:1789120698.165205:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:3.0:1789120698.165270:0:6707:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa4d15 00002000:00100000:3.0:1789120698.165284:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76510092-6f58-4075-a7f3-7af5ca8b7da2/ffff9ffdb990f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789120698.165298:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789120698.166550:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789120698.166615:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120698.166975:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901296640:12345-192.168.206.9@tcp:8: Request processed in 1842us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120698.166989:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:3.0:1789120698.167032:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120698.167040:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901296768:12345-192.168.206.9@tcp:8: 00010000:00080000:3.0:1789120698.167071:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:3.0:1789120698.167104:0:6707:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa4d1c 00002000:00100000:3.0:1789120698.167117:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76510092-6f58-4075-a7f3-7af5ca8b7da2/ffff9ffdb990c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789120698.167161:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789120698.168584:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789120698.168640:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120698.171664:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901296768:12345-192.168.206.9@tcp:8: Request processed in 1658us (7730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120698.171687:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000004:00080000:2.0:1789120698.187771:0:5860:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26156us 00000004:00200000:2.0:1789120698.214874:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789120698.215128:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5577:x1876028901296896:12345-192.168.206.9@tcp:33: Request processed in 53599us (54052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120698.215161:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789120698.425920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120698.426094:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297152 00000100:00100000:2.0:1789120698.426106:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297152 00000100:00100000:2.0:1789120698.426217:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789120698.426229:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5618:x1876028901297152:12345-192.168.206.9@tcp:101: 00010000:00010000:2.0:1789120698.426255:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120698.429767:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa4d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac8d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.429847:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.429861:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.429874:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120698.430083:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789120698.430087:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120698.430185:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.430216:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa4d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac8d expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.430233:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac8d expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120698.430242:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd84cf3c00) 00010000:00010000:2.0:1789120698.430245:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120698.430248:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149ac00, rc 0) 00000100:00100000:2.0:1789120698.430326:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:5618:x1876028901297152:12345-192.168.206.9@tcp:101: Request processed in 4098us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120698.430335:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:3.0:1789120698.604545:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120699.114539:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922290048:0@lo:400: 00000100:00100000:0.0:1789120699.114617:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120699.114677:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922290560:0@lo:400: 00000100:00100000:0.0:1789120699.114709:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120699.114746:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120699.114752:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922290432:0@lo:400: 00000100:00100000:0.0:1789120699.114778:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120699.114867:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922290176:0@lo:400: 00000100:00100000:3.0:1789120699.114897:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120699.114935:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922290688:0@lo:400: 00000100:00100000:1.0:1789120699.114951:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290048 00000100:00100000:3.0:1789120699.114964:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120699.114968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290048 00000100:00100000:3.0:1789120699.115005:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789120699.115012:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922290304:0@lo:400: 00000100:00100000:3.0:1789120699.115039:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120699.115054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120699.115069:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922290048:12345-0@lo:400: 00000100:00100000:3.0:1789120699.115071:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922290816:0@lo:13: 00000100:00100000:3.0:1789120699.115108:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120699.115178:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290432 00000100:00100000:2.0:1789120699.115185:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290432 00000100:00100000:2.0:1789120699.115234:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290688 00000100:00100000:2.0:1789120699.115237:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290688 00000100:00100000:2.0:1789120699.115254:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120699.115262:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922290432:12345-0@lo:400: 00000100:00100000:0.0:1789120699.115410:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290560 00000100:00100000:0.0:1789120699.115414:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290560 00000100:00100000:0.0:1789120699.115437:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290176 00000100:00100000:0.0:1789120699.115440:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290176 00000100:00100000:0.0:1789120699.115451:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290304 00000100:00100000:0.0:1789120699.115453:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290304 00000100:00100000:0.0:1789120699.115466:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120699.115472:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922290560:12345-0@lo:400: 00000100:00100000:3.0:1789120699.115554:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290816 00000100:00100000:3.0:1789120699.115559:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290816 00000100:00100000:3.0:1789120699.115596:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120699.115603:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922290816:12345-0@lo:13: 00002000:00000024:3.0:1789120699.115619:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120699.115664:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922290816:12345-0@lo:13: Request processed in 60us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120699.115672:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120699.115717:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922290048:12345-0@lo:400: Request processed in 649us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120699.115718:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789120699.115733:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789120699.115737:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1789120699.115783:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5907840 x1876028922290816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120699.115795:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789120699.115822:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922290816:0@lo:13: 00000100:00100000:1.0:1789120699.115824:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922290048:0@lo:400: 00000100:00100000:1.0:1789120699.115872:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789120699.115877:0:5859:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120699.115886:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120699.115887:0:5859:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789120699.115908:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120699.115908:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922290688:12345-0@lo:400: 00000100:00100000:3.0:1789120699.115930:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120699.115940:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922290176:12345-0@lo:400: 00000100:00100000:1.0:1789120699.116016:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922290688:12345-0@lo:400: Request processed in 114us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120699.116020:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922290176:12345-0@lo:400: Request processed in 79us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120699.116031:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120699.116039:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120699.116078:0:5858:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120699.116091:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922290176:0@lo:400: 00000100:00100000:3.0:1789120699.116101:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789120699.116109:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922290304:12345-0@lo:400: 00000100:00100000:3.0:1789120699.116174:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922290304:12345-0@lo:400: Request processed in 65us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120699.116180:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789120699.116206:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120699.116211:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120699.116213:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789120699.116659:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffda31fde00 x1876028922290688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120699.116691:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922290688:0@lo:400: 00000100:00100000:1.0:1789120699.116728:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922290304:0@lo:400: 00000100:00100000:2.0:1789120699.117480:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922290432:12345-0@lo:400: Request processed in 2211us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120699.117492:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789120699.117659:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f64000 x1876028922290432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120699.117675:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922290432:0@lo:400: 00000100:00100000:0.0:1789120699.117723:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922290560:12345-0@lo:400: Request processed in 2246us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120699.117741:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922290560:0@lo:400: 00000100:00100000:0.0:1789120699.117748:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789120699.627339:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120700.515730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120700.515812:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297280 00000100:00100000:3.0:1789120700.515821:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297280 00000100:00100000:3.0:1789120700.515894:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120700.515903:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:5670:x1876028901297280:12345-192.168.206.9@tcp:41: 00000004:00000024:3.0:1789120700.515954:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789120700.516025:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:5670:x1876028901297280:12345-192.168.206.9@tcp:41: Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120700.516033:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00080000:0.0:1789120700.516111:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120700.523988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120700.524115:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297408 00000100:00100000:3.0:1789120700.524129:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297408 00000100:00100000:3.0:1789120700.524305:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789120700.524318:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5670:x1876028901297408:12345-192.168.206.9@tcp:13: 00002000:00000024:3.0:1789120700.524369:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120700.524461:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5670:x1876028901297408:12345-192.168.206.9@tcp:13: Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120700.524470:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120700.527280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120700.527430:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297536 00000100:00100000:3.0:1789120700.527442:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297536 00000100:00080000:0.0:1789120700.529683:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120700.529694:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120700.530869:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789120700.530894:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5670:x1876028901297536:12345-192.168.206.9@tcp:13: 00002000:00000024:3.0:1789120700.530974:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120700.531065:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:5670:x1876028901297536:12345-192.168.206.9@tcp:13: Request processed in 182us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120700.531073:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00010000:00010000:3.0:1789120700.652555:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120701.677581:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789120702.301393:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00010000:00010000:2.0:1789120702.698491:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120702.700910:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922290944:0@lo:13: 00000100:00100000:3.0:1789120702.701006:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120702.701108:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922290944 00000100:00100000:3.0:1789120702.701131:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922290944 00000100:00100000:3.0:1789120702.703073:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789120702.703094:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922290944:12345-0@lo:13: 00002000:00000024:3.0:1789120702.703159:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120702.704394:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922290944:12345-0@lo:13: Request processed in 1298us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120702.704410:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789120702.704494:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b68f00 x1876028922290944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120702.704522:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922290944:0@lo:13: 00000100:00080000:1.0:1789120702.708252:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789120702.766194:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000001:00100000:3.0:1789120702.794856:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000001:02000400:0.0:1789120703.074884:0:8305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789120703.411139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120703.411209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120703.411254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120703.411280:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298048 00000100:00100000:0.0:1789120703.411290:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298048 00000100:00100000:3.0:1789120703.411308:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297792 00000100:00100000:3.0:1789120703.411314:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297792 00000100:00080000:1.0:1789120703.411620:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120703.411625:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120703.420727:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789120703.420762:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901297792:12345-192.168.206.9@tcp:400: 00000100:00100000:3.0:1789120703.420856:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901297792:12345-192.168.206.9@tcp:400: Request processed in 117us (9726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120703.420878:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:2.0:1789120703.424573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120703.430693:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297664 00000100:00100000:3.0:1789120703.430709:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297664 00000100:00100000:3.0:1789120703.430786:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:3.0:1789120703.430796:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2349:x1876028901297664:12345-192.168.206.9@tcp:400: 00000100:00100000:3.0:1789120703.430873:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2349:x1876028901297664:12345-192.168.206.9@tcp:400: Request processed in 78us (19619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120703.430881:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:0.0:1789120703.437319:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901297920 00000100:00100000:0.0:1789120703.437333:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901297920 00000100:00080000:2.0:1789120703.437452:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120703.439401:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120703.439428:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901298048:12345-192.168.206.9@tcp:400: 00000100:00100000:3.0:1789120703.439675:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901298048:12345-192.168.206.9@tcp:400: Request processed in 260us (28465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120703.439684:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120703.439708:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789120703.439715:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901297920:12345-192.168.206.9@tcp:400: 00000100:00100000:3.0:1789120703.439745:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901297920:12345-192.168.206.9@tcp:400: Request processed in 32us (15645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120703.439751:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00010000:00010000:0.0:1789120703.723432:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120704.235465:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922291072:0@lo:400: 00000100:00100000:2.0:1789120704.235533:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235605:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922291584:0@lo:400: 00000100:00100000:2.0:1789120704.235632:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235658:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120704.235664:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922291456:0@lo:400: 00000100:00100000:2.0:1789120704.235688:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235716:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922291328:0@lo:400: 00000100:00100000:2.0:1789120704.235752:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235772:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789120704.235778:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922291200:0@lo:400: 00000100:00100000:2.0:1789120704.235799:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235821:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9505a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922291712:0@lo:400: 00000100:00100000:2.0:1789120704.235840:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120704.235866:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291456 00000100:00100000:2.0:1789120704.235871:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291456 00000100:00100000:2.0:1789120704.235916:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291712 00000100:00100000:2.0:1789120704.235920:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291712 00000100:00100000:2.0:1789120704.235941:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120704.235950:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922291456:12345-0@lo:400: 00000100:00100000:2.0:1789120704.236000:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922291456:12345-0@lo:400: Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120704.236018:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120704.236034:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120704.236040:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922291712:12345-0@lo:400: 00000100:00100000:2.0:1789120704.236069:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922291712:12345-0@lo:400: Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120704.236074:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120704.236090:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291584 00000100:00100000:2.0:1789120704.236093:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291584 00000100:00100000:2.0:1789120704.236113:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291328 00000100:00100000:2.0:1789120704.236115:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291328 00000100:00100000:2.0:1789120704.236125:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291200 00000100:00100000:2.0:1789120704.236127:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291200 00000100:00100000:2.0:1789120704.236136:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120704.236163:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9506580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922291584:12345-0@lo:400: 00000100:00100000:2.0:1789120704.236192:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9506580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922291584:12345-0@lo:400: Request processed in 50us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120704.236197:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120704.236207:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789120704.236213:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922291328:12345-0@lo:400: 00000100:00100000:2.0:1789120704.236239:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922291328:12345-0@lo:400: Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120704.236244:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789120704.236255:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120704.236261:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922291200:12345-0@lo:400: 00000100:00100000:2.0:1789120704.236286:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922291200:12345-0@lo:400: Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120704.236301:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789120704.236318:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120704.236323:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120704.236325:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120704.236355:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922291200:0@lo:400: 00010000:00080000:2.0:1789120704.236368:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb9505a40 x1876028922291712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120704.236378:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9505a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922291712:0@lo:400: 00000100:00100000:2.0:1789120704.236387:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5485e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922291328:0@lo:400: 00010000:00080000:2.0:1789120704.236418:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54843c0 x1876028922291456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120704.236428:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922291456:0@lo:400: 00000100:00100000:2.0:1789120704.236437:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922291584:0@lo:400: 00000100:00100000:0.0:1789120704.238592:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291072 00000100:00100000:0.0:1789120704.238612:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291072 00000100:00100000:0.0:1789120704.238680:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789120704.238689:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922291072:12345-0@lo:400: 00000100:00100000:0.0:1789120704.238777:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922291072:12345-0@lo:400: Request processed in 90us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120704.238785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789120704.238845:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922291072:0@lo:400: 00000100:00100000:1.0:1789120704.242971:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120704.242993:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922291840:0@lo:13: 00000100:00100000:1.0:1789120704.243057:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120704.243124:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922291840 00000100:00100000:1.0:1789120704.243131:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922291840 00000100:00100000:1.0:1789120704.243203:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789120704.243211:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922291840:12345-0@lo:13: 00002000:00000024:1.0:1789120704.243243:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120704.243286:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922291840:12345-0@lo:13: Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120704.243293:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789120704.243329:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5907840 x1876028922291840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120704.243345:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922291840:0@lo:13: 00010000:00010000:2.0:1789120704.746423:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120705.771786:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789120706.168719:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf5800380 20000000:00000080:0.0:1789120706.168735:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdb991bc00 uarg=0000000000000000 20000000:01000000:0.0:1789120706.168768:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789120706.168771:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789120706.168773:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789120706.168778:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789120706.168787:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789120706.168801:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789120706.168803:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789120706.168981:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789120706.168984:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789120706.170565:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789120706.171097:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789120706.171295:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789120706.171336:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789120706.171351:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789120706.171353:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120706.172276:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789120706.176667:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789120706.176717:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789120706.176771:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789120706.176784:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789120706.176787:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120706.177786:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789120706.178529:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789120706.178593:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789120706.178632:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789120706.178647:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789120706.178649:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120706.179631:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789120706.180011:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789120706.180072:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789120706.180113:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789120706.180127:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789120706.180176:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180194:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180202:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180209:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180216:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180223:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180229:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180235:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180252:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180259:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180266:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180303:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180318:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 9 pid: 5851 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180332:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922291968:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120706.180584:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180594:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180602:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292096:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120706.180631:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180638:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 18 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180656:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292224:0@lo:104: 00000100:00100000:0.0:1789120706.180689:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120706.180724:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180733:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 18 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180741:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292352:0@lo:104: 00000100:00100000:0.0:1789120706.180762:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120706.180782:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180790:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 18 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180798:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292480:0@lo:104: 00010000:00010000:0.0:1789120706.180819:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180826:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 18 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180833:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292608:0@lo:104: 00010000:00010000:0.0:1789120706.180854:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180862:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 18 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180877:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292736:0@lo:104: 00010000:00010000:0.0:1789120706.180901:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180909:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 18 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.180916:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292864:0@lo:104: 00010000:00010000:0.0:1789120706.180938:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.180946:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 18 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.181258:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292992:0@lo:104: 00000100:00100000:0.0:1789120706.181296:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120706.181384:0:5840:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789120706.181404:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.181419:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.181426:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.181445:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.181457:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.181465:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292224 00000100:00100000:2.0:1789120706.181470:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292224 00000100:00100000:2.0:1789120706.181502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292352 00000100:00100000:2.0:1789120706.181512:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292352 00000100:00100000:2.0:1789120706.181527:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292480 00000100:00100000:2.0:1789120706.181529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292480 00000100:00100000:2.0:1789120706.181537:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292608 00000100:00100000:2.0:1789120706.181539:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292608 00000100:00100000:2.0:1789120706.181558:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292736 00000100:00100000:2.0:1789120706.181560:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292736 00000100:00100000:2.0:1789120706.181569:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292864 00000100:00100000:2.0:1789120706.181571:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292864 00000100:00100000:2.0:1789120706.181578:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922292992 00000100:00100000:2.0:1789120706.181580:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922292992 00000100:00100000:2.0:1789120706.181590:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120706.181596:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:8453:x1876028922292224:12345-0@lo:104: 00010000:00010000:2.0:1789120706.181608:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.181664:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120706.181669:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+9:8453:x1876028922292224:12345-0@lo:104: Request processed in 74us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.181675:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120706.181691:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120706.181697:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+8:8453:x1876028922292352:12345-0@lo:104: 00010000:00010000:2.0:1789120706.181704:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.181737:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120706.181742:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+8:8453:x1876028922292352:12345-0@lo:104: Request processed in 46us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.181748:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120706.181776:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120706.181789:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+7:8453:x1876028922292480:12345-0@lo:104: 00010000:00010000:2.0:1789120706.181797:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.181823:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789120706.181828:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+7:8453:x1876028922292480:12345-0@lo:104: Request processed in 40us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.181833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120706.181845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120706.181851:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9507840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:8453:x1876028922292608:12345-0@lo:104: 00010000:00010000:2.0:1789120706.181857:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.181881:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789120706.181886:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9507840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+6:8453:x1876028922292608:12345-0@lo:104: Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.181891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120706.181903:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120706.181909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:8453:x1876028922292736:12345-0@lo:104: 00010000:00010000:2.0:1789120706.181916:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.181941:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789120706.181945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:8453:x1876028922292736:12345-0@lo:104: Request processed in 38us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.181968:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120706.181980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120706.181994:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:8453:x1876028922292864:12345-0@lo:104: 00010000:00010000:2.0:1789120706.182002:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182031:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789120706.182035:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:8453:x1876028922292864:12345-0@lo:104: Request processed in 44us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.182041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120706.182053:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120706.182060:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:8453:x1876028922292992:12345-0@lo:104: 00010000:00010000:2.0:1789120706.182066:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182089:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789120706.182094:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:8453:x1876028922292992:12345-0@lo:104: Request processed in 36us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.182099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789120706.182120:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789120706.182125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182132:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a000 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182135:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182166:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182174:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182186:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182214:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182220:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182238:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182245:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a000/0x13cfa3d77faa4cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4ce4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182257:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789120706.182261:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182266:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182269:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182276:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182282:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182286:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182298:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182304:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182316:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182322:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a800/0x13cfa3d77faa4cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4cba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182331:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789120706.182334:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182339:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182342:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182349:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182354:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182360:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182372:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182378:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182392:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182398:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149a200/0x13cfa3d77faa4c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c9e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182407:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789120706.182415:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182421:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149aa00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182424:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182430:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182437:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182441:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182454:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182460:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182465:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182471:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149aa00/0x13cfa3d77faa4c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182481:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789120706.182484:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182490:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390bc00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182492:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182509:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182515:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182521:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182533:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182539:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182553:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182560:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390bc00/0x13cfa3d77faa4c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c82 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182570:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120706.182572:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182578:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149be00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182581:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182587:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182593:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182604:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182617:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182622:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182626:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182632:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149be00/0x13cfa3d77faa4c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c58 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182641:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120706.182643:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182648:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120706.182650:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182656:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120706.182662:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120706.182667:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120706.182678:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182683:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120706.182694:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa4c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c2e expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.182713:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120706.182715:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120706.182717:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120706.182731:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120706.182743:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293120:0@lo:103: 00000100:00100000:2.0:1789120706.182778:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182800:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9507c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293632:0@lo:103: 00000100:00100000:2.0:1789120706.182816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182833:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789120706.182839:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293248:0@lo:103: 00000100:00100000:2.0:1789120706.182859:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182875:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293760:0@lo:103: 00000100:00100000:2.0:1789120706.182904:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182928:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb95070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293376:0@lo:103: 00000100:00100000:2.0:1789120706.182949:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182958:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293888:0@lo:103: 00000100:00100000:2.0:1789120706.182973:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.182982:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120706.182986:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293504:0@lo:103: 00000100:00100000:2.0:1789120706.183005:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120706.183025:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293120 00000100:00100000:2.0:1789120706.183037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293120 00010000:00010000:2.0:1789120706.183059:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 19 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293632 00000100:00100000:2.0:1789120706.183078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293632 00010000:00010000:2.0:1789120706.183088:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 20 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293248 00000100:00100000:2.0:1789120706.183099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293248 00010000:00010000:2.0:1789120706.183108:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 21 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183117:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293760 00000100:00100000:2.0:1789120706.183119:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293760 00010000:00010000:2.0:1789120706.183127:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 22 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293376 00000100:00100000:2.0:1789120706.183137:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293376 00010000:00010000:2.0:1789120706.183164:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 23 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293888 00000100:00100000:2.0:1789120706.183176:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293888 00010000:00010000:2.0:1789120706.183184:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 24 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922293504 00000100:00100000:2.0:1789120706.183193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922293504 00010000:00010000:2.0:1789120706.183201:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 25 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120706.183224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120706.183230:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+25:3317:x1876028922293120:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183239:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183243:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 25 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183251:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 25 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183265:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183293:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+25:3317:x1876028922293120:12345-0@lo:103: Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183299:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120706.183311:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120706.183316:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+24:3317:x1876028922293632:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183323:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183327:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 24 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183334:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 24 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183342:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183359:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+24:3317:x1876028922293632:12345-0@lo:103: Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183364:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120706.183373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120706.183383:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+23:3317:x1876028922293248:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183389:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183392:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 23 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183400:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 23 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183408:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183425:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+23:3317:x1876028922293248:12345-0@lo:103: Request processed in 43us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183431:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120706.183442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120706.183447:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+22:3317:x1876028922293760:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183453:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183457:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 22 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183463:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 22 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183471:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+22:3317:x1876028922293760:12345-0@lo:103: Request processed in 42us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120706.183504:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120706.183509:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+21:3319:x1876028922293376:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183515:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183524:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 21 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183532:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 21 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183540:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183577:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+21:3319:x1876028922293376:12345-0@lo:103: Request processed in 68us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183583:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120706.183594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120706.183600:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:3319:x1876028922293888:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183607:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183611:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 20 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183617:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 20 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183625:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183643:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:3319:x1876028922293888:12345-0@lo:103: Request processed in 43us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120706.183658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120706.183663:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922293504:12345-0@lo:103: 00010000:00010000:2.0:1789120706.183669:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120706.183672:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 19 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183689:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 19 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.183698:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120706.183717:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922293504:12345-0@lo:103: Request processed in 55us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120706.183723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120706.183774:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9504f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293504:0@lo:103: 00000100:00100000:2.0:1789120706.183782:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb95070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293376:0@lo:103: 00000100:00100000:2.0:1789120706.183789:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922293888:0@lo:103: 00000100:00100000:2.0:1789120706.183815:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293248:0@lo:103: 00000100:00100000:2.0:1789120706.183821:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293760:0@lo:103: 00000100:00100000:2.0:1789120706.183828:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293120:0@lo:103: 00000100:00100000:2.0:1789120706.183834:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9507c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922293632:0@lo:103: 00010000:00010000:0.0:1789120706.184180:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa4ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4cdd expref: 18 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184193:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292224:0@lo:104: 00010000:00010000:0.0:1789120706.184203:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa4cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4cb3 expref: 17 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184211:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292352:0@lo:104: 00010000:00010000:0.0:1789120706.184221:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390aa00/0x13cfa3d77faa4c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c97 expref: 16 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184229:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292480:0@lo:104: 00010000:00010000:0.0:1789120706.184247:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390a800/0x13cfa3d77faa4c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c89 expref: 15 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184256:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292608:0@lo:104: 00010000:00010000:0.0:1789120706.184265:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c7b expref: 14 pid: 5851 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184274:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292736:0@lo:104: 00010000:00010000:0.0:1789120706.184282:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c51 expref: 13 pid: 5852 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184291:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292864:0@lo:104: 00010000:00010000:0.0:1789120706.184299:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c27 expref: 12 pid: 5850 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120706.184307:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292992:0@lo:104: 00000100:00100000:2.0:1789120706.188106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120706.188123:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922291968:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120706.188135:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1876028922292096:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120706.188199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:0.0:1789120706.188200:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120706.188612:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298176 00000100:00100000:1.0:1789120706.188619:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298176 00010000:00010000:1.0:1789120706.188654:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 10 pid: 5851 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120706.188686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298304 00000100:00100000:1.0:1789120706.188689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298304 00010000:00010000:1.0:1789120706.188701:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 11 pid: 5852 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120706.188716:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789120706.188724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:2350:x1876028901298176:12345-192.168.206.9@tcp:103: 00010000:00010000:1.0:1789120706.188736:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120706.188741:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 11 pid: 5851 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188769:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 11 pid: 5851 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188793:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac32 expref: 11 pid: 5851 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188809:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120706.188861:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901298176:12345-192.168.206.9@tcp:103: Request processed in 137us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120706.188869:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789120706.188885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:1.0:1789120706.188892:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:2350:x1876028901298304:12345-192.168.206.9@tcp:103: 00010000:00010000:1.0:1789120706.188901:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120706.188906:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188914:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188924:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149ba00/0x13cfa3d77faa4cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac2b expref: 9 pid: 5852 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188935:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188943:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188980:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188988:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.188994:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.189001:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.189007:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120706.189010:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.189017:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.189029:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120706.189038:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120706.189059:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+8:2350:x1876028901298304:12345-192.168.206.9@tcp:103: Request processed in 167us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120706.189065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00010000:00010000:0.0:1789120706.189440:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.189448:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120706.189454:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4a800/0x13cfa3d77faa4d31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120706.794346:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789120707.370312:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789120707.370319:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdbfb5a800 from 39 10000000:01000000:0.0:1789120707.370324:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120707.370364:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.370376:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.370386:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120707.370407:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294016:0@lo:101: 00000100:00100000:0.0:1789120707.370470:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.370530:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.370683:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294016 00000100:00100000:3.0:1789120707.370690:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294016 00000100:00100000:3.0:1789120707.370746:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789120707.370755:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+12:5854:x1876028922294016:12345-0@lo:101: 00010000:00010000:3.0:1789120707.370766:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120707.370779:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390b200/0x13cfa3d77faa4d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d38 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.370816:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390b200/0x13cfa3d77faa4d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d38 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.370827:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390b200/0x13cfa3d77faa4d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d38 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.370835:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b200, rc 0) 00000100:00100000:3.0:1789120707.370923:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294016:12345-0@lo:101: Request processed in 169us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.370931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789120707.371364:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294016:0@lo:101: 00010000:00010000:1.0:1789120707.371381:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.371403:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.371457:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294144:0@lo:501: 00000100:00100000:1.0:1789120707.371488:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.371522:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.371790:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294144 00000100:00100000:0.0:1789120707.371796:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294144 00000100:00100000:0.0:1789120707.371869:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789120707.371878:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294144:12345-0@lo:501: 00000100:00100000:0.0:1789120707.372117:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294144:12345-0@lo:501: Request processed in 240us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.372125:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789120707.372226:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294144:0@lo:501: 00000100:00100000:1.0:1789120707.372256:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294272:0@lo:503: 00000100:00100000:1.0:1789120707.372295:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.372677:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.372837:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294272 00000100:00100000:3.0:1789120707.372843:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294272 00000100:00100000:3.0:1789120707.372871:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789120707.372878:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294272:12345-0@lo:503: 00000100:00100000:3.0:1789120707.373036:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294272:12345-0@lo:503: Request processed in 158us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.373044:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789120707.373157:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294272:0@lo:503: 00000100:00100000:1.0:1789120707.373902:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8470:1876028922294400:0@lo:502: 00000100:00100000:1.0:1789120707.373949:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.373980:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.374017:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294400 00000100:00100000:3.0:1789120707.374022:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294400 00000100:00100000:3.0:1789120707.374050:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789120707.374057:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:8470:x1876028922294400:12345-0@lo:502: 00000100:00100000:3.0:1789120707.374390:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:8470:x1876028922294400:12345-0@lo:502: Request processed in 333us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.374403:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789120707.374500:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8470:1876028922294400:0@lo:502: 00000100:00100000:1.0:1789120707.374611:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8470:1876028922294528:0@lo:502: 00000100:00100000:1.0:1789120707.374651:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120707.374841:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294528 00000100:00100000:2.0:1789120707.374846:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294528 00000100:00100000:2.0:1789120707.374880:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789120707.374888:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:8470:x1876028922294528:12345-0@lo:502: 00000100:00100000:2.0:1789120707.375067:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:8470:x1876028922294528:12345-0@lo:502: Request processed in 180us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.375083:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789120707.382714:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.382755:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8470:1876028922294528:0@lo:502: 00000040:00080000:1.0:1789120707.382866:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789120707.383118:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789120707.383136:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120707.383165:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.383177:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120707.383254:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789120707.383257:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789120707.383260:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789120707.383360:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.383370:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.383379:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120707.383397:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294656:0@lo:101: 00000100:00100000:0.0:1789120707.385127:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.385474:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.385652:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294656 00000100:00100000:3.0:1789120707.385660:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294656 00000100:00100000:3.0:1789120707.385773:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789120707.385794:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+13:5854:x1876028922294656:12345-0@lo:101: 00010000:00010000:3.0:1789120707.385809:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120707.385825:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390be00/0x13cfa3d77faa4d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d46 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.385849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390be00/0x13cfa3d77faa4d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d46 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.385859:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390be00/0x13cfa3d77faa4d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d46 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.385867:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390be00, rc 0) 00000100:00100000:3.0:1789120707.385928:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922294656:12345-0@lo:101: Request processed in 136us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.385936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789120707.385977:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294656:0@lo:101: 00010000:00010000:1.0:1789120707.386003:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.386023:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.386090:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294784:0@lo:501: 00000100:00100000:1.0:1789120707.386120:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.386142:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.386282:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294784 00000100:00100000:2.0:1789120707.386288:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294784 00000100:00100000:2.0:1789120707.386323:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789120707.386331:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922294784:12345-0@lo:501: 00000100:00100000:2.0:1789120707.386643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922294784:12345-0@lo:501: Request processed in 312us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.386650:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789120707.386865:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294784:0@lo:501: 00000100:00100000:1.0:1789120707.386892:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294912:0@lo:503: 00000100:00100000:1.0:1789120707.386930:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.386964:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.387077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922294912 00000100:00100000:0.0:1789120707.387082:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922294912 00000100:00100000:0.0:1789120707.387113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120707.387120:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922294912:12345-0@lo:503: 00000100:00100000:0.0:1789120707.387398:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922294912:12345-0@lo:503: Request processed in 277us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.387406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789120707.388340:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922294912:0@lo:503: 00000100:00100000:1.0:1789120707.388923:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8471:1876028922295040:0@lo:502: 00000100:00100000:1.0:1789120707.388977:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.389021:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.389074:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295040 00000100:00100000:3.0:1789120707.389079:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295040 00000100:00100000:3.0:1789120707.389127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789120707.389136:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:8471:x1876028922295040:12345-0@lo:502: 00000100:00100000:3.0:1789120707.389491:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:8471:x1876028922295040:12345-0@lo:502: Request processed in 356us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.389498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789120707.389607:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8471:1876028922295040:0@lo:502: 00000020:01000000:1.0:1789120707.389628:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120707.389636:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120707.389638:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789120707.389643:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789120707.389662:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8471:1876028922295168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120707.389694:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.389759:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.389795:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295168 00000100:00100000:0.0:1789120707.389799:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295168 00000100:00100000:0.0:1789120707.389834:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789120707.389850:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:8471:x1876028922295168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120707.389974:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:8471:x1876028922295168:12345-0@lo:502:llog_process_th.0 Request processed in 125us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.389997:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789120707.390520:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8471:1876028922295168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120707.390556:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120707.390566:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120707.390568:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789120707.390572:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789120707.390705:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789120707.390724:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789120707.390733:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.390743:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120707.390752:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789120707.390755:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdaf537000 from 39 10000000:01000000:0.0:1789120707.390758:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120707.390849:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.390858:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.390867:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120707.390882:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.390914:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.390949:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503300 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.391000:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295296 00000100:00100000:1.0:1789120707.391005:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295296 00000100:00100000:1.0:1789120707.391039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789120707.391047:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:5854:x1876028922295296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120707.391056:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120707.391067:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691200/0x13cfa3d77faa4d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d54 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.391087:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691200/0x13cfa3d77faa4d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d54 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.391097:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691200/0x13cfa3d77faa4d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d54 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.391105:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691200, rc 0) 00000100:00100000:1.0:1789120707.391231:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.391238:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789120707.391410:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120707.391421:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.391442:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120707.391484:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.391510:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.391549:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503300 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.391603:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295424 00000100:00100000:3.0:1789120707.391607:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295424 00000100:00100000:3.0:1789120707.391664:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789120707.391671:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.391898:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.391915:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789120707.391976:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.392012:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.392047:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.392476:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503300 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.392565:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295552 00000100:00100000:1.0:1789120707.392570:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295552 00000100:00100000:1.0:1789120707.392592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789120707.392599:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.392739:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.392747:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789120707.392867:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.393183:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8472:1876028922295680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120707.393220:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.393236:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.393310:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295680 00000100:00100000:1.0:1789120707.393321:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295680 00000100:00100000:1.0:1789120707.393344:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789120707.393351:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:8472:x1876028922295680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120707.393551:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:8472:x1876028922295680:12345-0@lo:502:llog_process_th.0 Request processed in 200us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.393559:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789120707.393678:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8472:1876028922295680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120707.393716:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8472:1876028922295808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120707.393747:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120707.393843:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.393913:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295808 00000100:00100000:1.0:1789120707.393917:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295808 00000100:00100000:1.0:1789120707.393932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789120707.393937:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:8472:x1876028922295808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120707.394059:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:8472:x1876028922295808:12345-0@lo:502:llog_process_th.0 Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.394065:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789120707.394128:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8472:1876028922295808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789120707.394169:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789120707.394762:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789120707.394845:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120707.394854:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.394868:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120707.394877:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789120707.394880:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789120707.394883:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120707.394910:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.394917:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.394934:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.394948:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.394978:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.395009:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.395048:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922295936 00000100:00100000:0.0:1789120707.395054:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922295936 00000100:00100000:0.0:1789120707.395076:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789120707.395089:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:5854:x1876028922295936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120707.395099:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120707.395110:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa4d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d62 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.395129:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa4d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d62 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.395138:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa4d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d62 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120707.395168:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ae00, rc 0) 00000100:00100000:0.0:1789120707.395201:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922295936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.395207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120707.395363:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922295936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120707.395375:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.395384:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.395423:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.395445:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.395466:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.395501:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296064 00000100:00100000:0.0:1789120707.395505:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296064 00000100:00100000:0.0:1789120707.395521:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789120707.395526:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922296064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.395789:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922296064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.395796:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120707.395992:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.396020:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.396055:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.396099:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.396127:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296192 00000100:00100000:0.0:1789120707.396132:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296192 00000100:00100000:0.0:1789120707.396584:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789120707.396593:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922296192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120707.396888:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922296192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.396900:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789120707.397422:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.398738:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8473:1876028922296320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120707.398794:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.398871:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.398911:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296320 00000100:00100000:2.0:1789120707.398917:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296320 00000100:00100000:2.0:1789120707.399605:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789120707.399617:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:8473:x1876028922296320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120707.399855:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:8473:x1876028922296320:12345-0@lo:502:llog_process_th.0 Request processed in 241us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.399862:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789120707.399933:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8473:1876028922296320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120707.399958:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120707.399967:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120707.399969:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789120707.399974:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789120707.399999:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8473:1876028922296448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120707.400047:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.400747:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296448 00000100:00100000:3.0:1789120707.400756:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296448 00000100:00100000:3.0:1789120707.400787:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789120707.400795:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:8473:x1876028922296448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.400943:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:8473:x1876028922296448:12345-0@lo:502:llog_process_th.0 Request processed in 148us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.400951:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789120707.401219:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.401236:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8473:1876028922296448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120707.401258:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120707.401327:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120707.401330:0:8473:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789120707.401334:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789120707.401570:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789120707.401589:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789120707.401598:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.401609:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120707.401619:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789120707.401621:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd85287800 from 39 10000000:01000000:1.0:1789120707.401624:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789120707.401648:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.401656:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.401663:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.401756:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.401792:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.401827:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.401915:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296576 00000100:00100000:2.0:1789120707.401920:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296576 00000100:00100000:2.0:1789120707.401957:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789120707.401965:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922296576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120707.401974:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120707.401985:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5800/0x13cfa3d77faa4d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d70 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.402112:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5800/0x13cfa3d77faa4d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d70 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.402122:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5800/0x13cfa3d77faa4d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d70 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.402136:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5800, rc 0) 00000100:00100000:2.0:1789120707.402232:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922296576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.402239:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789120707.402264:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120707.402349:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.402356:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.402410:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.402433:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.402462:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789120707.402508:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296704 00000100:00100000:3.0:1789120707.402512:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296704 00000100:00100000:3.0:1789120707.402550:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789120707.402558:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922296704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.402844:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922296704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.402852:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789120707.402921:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.402946:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.402980:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.403002:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.403208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296832 00000100:00100000:2.0:1789120707.403212:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296832 00000100:00100000:2.0:1789120707.403271:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120707.403278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922296832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.403422:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922296832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.403429:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789120707.403488:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922296832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.408424:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8474:1876028922296960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.408507:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.408567:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120707.408625:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922296960 00000100:00100000:0.0:1789120707.408638:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922296960 00000100:00100000:0.0:1789120707.408685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789120707.408694:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8474:x1876028922296960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120707.409058:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8474:x1876028922296960:12345-0@lo:502:llog_process_th.0 Request processed in 365us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.409066:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789120707.409361:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8474:1876028922296960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.409408:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8474:1876028922297088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.409442:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.409523:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.410508:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297088 00000100:00100000:2.0:1789120707.410515:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297088 00000100:00100000:3.0:1789120707.410775:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789120707.410841:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8474:x1876028922297088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.411200:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8474:x1876028922297088:12345-0@lo:502:llog_process_th.0 Request processed in 361us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120707.411208:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789120707.411421:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8474:1876028922297088:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789120707.411450:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789120707.411601:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789120707.411620:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120707.411628:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.411638:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120707.411657:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789120707.411660:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789120707.411663:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120707.411703:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.411711:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.411719:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120707.411737:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.411769:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120707.411814:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.411951:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297216 00000100:00100000:2.0:1789120707.411957:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297216 00000100:00100000:2.0:1789120707.411990:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789120707.411997:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922297216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120707.412006:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120707.412016:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5a00/0x13cfa3d77faa4d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d7e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.412044:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5a00/0x13cfa3d77faa4d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d7e expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.412063:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5a00/0x13cfa3d77faa4d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d7e expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.412071:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5a00, rc 0) 00000100:00100000:2.0:1789120707.412114:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.412120:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789120707.412171:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120707.412182:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.412190:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120707.412231:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d076940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.412253:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120707.412278:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb9437480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.412289:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297344 00000100:00100000:2.0:1789120707.412293:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297344 00000100:00100000:2.0:1789120707.412309:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789120707.412314:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.412504:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.412511:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789120707.412550:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d076940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.412583:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d076940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.412616:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120707.412629:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb9437480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.412638:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297472 00000100:00100000:2.0:1789120707.412642:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297472 00000100:00100000:2.0:1789120707.412657:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789120707.412663:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120707.413135:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 417us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.413163:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789120707.413201:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d076940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.414391:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8475:1876028922297600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.414447:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.414516:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120707.414561:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297600 00000100:00100000:2.0:1789120707.414567:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297600 00000100:00100000:2.0:1789120707.414638:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789120707.414656:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8475:x1876028922297600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120707.414936:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8475:x1876028922297600:12345-0@lo:502:llog_process_th.0 Request processed in 288us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.414944:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789120707.415013:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8475:1876028922297600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120707.415048:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120707.415056:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120707.415059:0:8475:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789120707.415064:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789120707.415272:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8475:1876028922297728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.415308:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.415618:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.415766:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297728 00000100:00100000:1.0:1789120707.415771:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297728 00000100:00100000:1.0:1789120707.415852:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789120707.415859:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8475:x1876028922297728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120707.416120:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8475:1876028922297728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120707.416159:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120707.416164:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120707.416166:0:8475:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789120707.416170:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789120707.416227:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789120707.416241:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789120707.416250:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.416260:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120707.416391:0:5854:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789120707.416394:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffd9cd18000 from 1 10000000:01000000:3.0:1789120707.416397:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789120707.416420:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.416428:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.416436:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120707.416451:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.416479:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.416490:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.416601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8475:x1876028922297728:12345-0@lo:502:llog_process_th.0 Request processed in 162us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.416609:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789120707.416636:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297856 00000100:00100000:1.0:1789120707.416639:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297856 00000100:00100000:1.0:1789120707.416762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789120707.416769:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922297856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120707.416778:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120707.416789:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4d8c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.416808:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d8c expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.416829:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4d8c expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.416838:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690a00, rc 0) 00000100:00100000:1.0:1789120707.416878:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922297856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.416884:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789120707.416946:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120707.416958:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.416966:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120707.417008:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120707.417183:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120707.417212:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120707.417264:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922297984 00000100:00100000:1.0:1789120707.417333:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922297984 00000100:00100000:1.0:1789120707.417354:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789120707.417360:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922297984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.417556:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922297984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (372us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120707.417564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789120707.417624:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922297984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789120707.417644:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789120707.417776:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120707.417785:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120707.695851:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120707.696672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298432 00000100:00100000:1.0:1789120707.696682:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298432 00000100:00100000:1.0:1789120707.696782:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:1.0:1789120707.696791:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+8:5591:x1876028901298432:12345-192.168.206.9@tcp:101: 00010000:00010000:1.0:1789120707.696807:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120707.696823:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac94 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.696849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac94 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.696860:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac94 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120707.696885:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691e00, rc 0) 00000100:00100000:1.0:1789120707.696951:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901298432:12345-192.168.206.9@tcp:101: Request processed in 160us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.696957:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:3.0:1789120707.698415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120707.701560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298560 00000100:00100000:2.0:1789120707.701574:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298560 00000100:00100000:1.0:1789120707.701685:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:1.0:1789120707.701747:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901298560:12345-192.168.206.9@tcp:501: 00000100:00100000:1.0:1789120707.702076:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901298560:12345-192.168.206.9@tcp:501: Request processed in 333us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.702085:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:0.0:1789120707.705743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120707.705936:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298688 00000100:00100000:2.0:1789120707.705950:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298688 00000100:00100000:2.0:1789120707.706020:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:2.0:1789120707.706030:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901298688:12345-192.168.206.9@tcp:503: 00000100:00100000:2.0:1789120707.706463:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901298688:12345-192.168.206.9@tcp:503: Request processed in 433us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.706476:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:3.0:1789120707.710260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120707.710357:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298816 00000100:00100000:1.0:1789120707.710371:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298816 00000100:00100000:1.0:1789120707.710501:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:1.0:1789120707.710511:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:6064:x1876028901298816:12345-192.168.206.9@tcp:502: 00000100:00100000:1.0:1789120707.712180:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:6064:x1876028901298816:12345-192.168.206.9@tcp:502: Request processed in 1662us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120707.712192:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:3.0:1789120707.717598:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120707.718052:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901298944 00000100:00100000:0.0:1789120707.718064:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901298944 00000100:00100000:0.0:1789120707.718175:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:0.0:1789120707.718188:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+9:6064:x1876028901298944:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120707.718555:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+9:6064:x1876028901298944:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 368us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120707.718565:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:0.0:1789120707.723233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120707.725016:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299072 00000100:00100000:2.0:1789120707.725030:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299072 00000100:00100000:2.0:1789120707.725101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:2.0:1789120707.725110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901299072:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120707.725125:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120707.725140:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5600/0x13cfa3d77faa4da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ac9b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.725198:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5600/0x13cfa3d77faa4da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac9b expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.725208:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5600/0x13cfa3d77faa4da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac9b expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120707.725216:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5600, rc 0) 00000100:00100000:2.0:1789120707.725278:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901299072:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 170us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.725285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:3.0:1789120707.728194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120707.728356:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299200 00000100:00100000:1.0:1789120707.728366:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299200 00000100:00100000:1.0:1789120707.728418:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00100000:1.0:1789120707.728427:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901299200:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120707.728918:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901299200:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 490us (731us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120707.728927:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 170 00010000:00010000:2.0:1789120707.819921:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120707.822565:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922298112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120707.822629:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120707.822718:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298112 00000100:00100000:2.0:1789120707.822725:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298112 00000100:00100000:2.0:1789120707.822779:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120707.822788:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922298112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120707.822817:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120707.822872:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922298112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120707.822880:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789120707.822907:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120707.822937:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b68f00 x1876028922298112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120707.822957:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922298112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120708.528633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120708.528721:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299328 00000100:00100000:0.0:1789120708.528731:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299328 00000100:00100000:0.0:1789120708.528793:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:0.0:1789120708.528810:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901299328:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120708.528878:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901299328:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120708.528886:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:0.0:1789120708.538193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120708.538227:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120708.538248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120708.538276:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299712 00000100:00100000:0.0:1789120708.538284:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299712 00000100:00100000:0.0:1789120708.538341:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299584 00000100:00100000:0.0:1789120708.538344:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299584 00000100:00100000:0.0:1789120708.538366:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789120708.538373:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901299712:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120708.538435:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901299712:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120708.538442:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789120708.538458:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789120708.538465:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901299584:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120708.538489:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901299584:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120708.538494:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00080000:0.0:1789120708.538510:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120708.538513:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120708.538684:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299456 00000100:00100000:3.0:1789120708.538688:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299456 00000100:00100000:3.0:1789120708.538728:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:3.0:1789120708.538736:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901299456:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120708.538769:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901299456:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 34us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120708.538775:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00080000:0.0:1789120708.538856:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120708.843331:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120709.354492:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789120709.354596:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120709.354676:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120709.354683:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789120709.354714:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120709.354762:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298496 00000100:00100000:3.0:1789120709.354771:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298496 00000100:00100000:3.0:1789120709.354838:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789120709.354849:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922298496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120709.354917:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922298496:12345-0@lo:400:kworker.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120709.354926:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789120709.354976:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922298496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355075:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922298368:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355107:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120709.355172:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922298880:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355199:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120709.355227:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120709.355234:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922298240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355264:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120709.355294:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922298752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355317:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120709.355347:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298624 00000100:00100000:0.0:1789120709.355351:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298624 00000100:00100000:0.0:1789120709.355386:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298880 00000100:00100000:0.0:1789120709.355389:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298880 00000100:00100000:0.0:1789120709.355415:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120709.355425:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355467:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922298624:12345-0@lo:400:kworker.0 Request processed in 45us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120709.355473:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120709.355487:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120709.355493:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922298880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355538:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922298880:12345-0@lo:400:kworker.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120709.355545:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789120709.355563:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120709.355567:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120709.355570:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120709.355584:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298368 00000100:00100000:0.0:1789120709.355587:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298368 00000100:00100000:0.0:1789120709.355607:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298752 00000100:00100000:0.0:1789120709.355610:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298752 00000100:00100000:0.0:1789120709.355646:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120709.355652:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922298368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355684:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922298368:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120709.355691:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120709.355702:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789120709.355708:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922298752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355735:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922298752:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120709.355741:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789120709.355762:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120709.355783:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922298752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120709.355794:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922298368:0@lo:400:kworker.0 00010000:00080000:0.0:1789120709.355807:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54de940 x1876028922298880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120709.355818:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922298880:0@lo:400:kworker.0 00010000:00080000:0.0:1789120709.355847:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54dfc00 x1876028922298624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120709.355857:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922298624:0@lo:400:kworker.0 00000100:00100000:1.0:1789120709.356010:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922298240 00000100:00100000:1.0:1789120709.356083:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922298240 00000100:00100000:3.0:1789120709.356089:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120709.356100:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922299008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120709.356125:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789120709.356132:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922298240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120709.356135:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120709.356194:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922298240:12345-0@lo:400:kworker.0 Request processed in 63us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120709.356201:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789120709.356202:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922298240:0@lo:400:kworker.0 00000100:00100000:2.0:1789120709.357037:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299008 00000100:00100000:2.0:1789120709.357047:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299008 00000100:00100000:2.0:1789120709.357095:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120709.357104:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922299008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120709.357168:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120709.357227:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922299008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120709.357235:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789120709.358330:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6cb40 x1876028922299008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120709.358365:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922299008:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789120709.362924:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4e844e90 20000000:00000080:1.0:1789120709.362947:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdb5dc0c00 uarg=0000000000000000 20000000:01000000:1.0:1789120709.362997:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789120709.363004:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789120709.363010:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789120709.364054:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789120709.367655:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789120709.377802:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789120709.377878:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789120709.378266:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789120709.378286:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789120709.378307:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378324:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378333:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378342:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378352:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378377:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378413:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378429:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 9 pid: 5852 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.378442:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299136:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120709.378557:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378878:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.378892:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299264:0@lo:104: 00000100:00100000:1.0:1789120709.378935:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120709.378975:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.378985:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.378994:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299392:0@lo:104: 00000100:00100000:1.0:1789120709.379014:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120709.379062:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120709.379064:0:5840:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789120709.379091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299264 00000100:00100000:2.0:1789120709.379102:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299264 00010000:00010000:1.0:1789120709.379108:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.379130:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5904000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299520:0@lo:104: 00000100:00100000:2.0:1789120709.379195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299392 00000100:00100000:2.0:1789120709.379203:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299392 00000100:00100000:1.0:1789120709.379204:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120709.379232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299520 00000100:00100000:2.0:1789120709.379238:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299520 00000100:00100000:1.0:1789120709.379255:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120709.380444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120709.380464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:8512:x1876028922299264:12345-0@lo:104: 00010000:00010000:3.0:1789120709.380488:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.380714:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299264:0@lo:104: 00010000:00010000:3.0:1789120709.380757:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120709.380764:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:8512:x1876028922299264:12345-0@lo:104: Request processed in 310us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120709.380772:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789120709.380802:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789120709.380809:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789120709.380817:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120709.380824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5522c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:8512:x1876028922299392:12345-0@lo:104: 00010000:00010000:2.0:1789120709.380848:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149b000 already unused, calling callback (ffffffffc1ab9c20) 00010000:00010000:3.0:1789120709.380852:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120709.380873:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.380885:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120709.380894:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120709.380900:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120709.380911:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120709.380931:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5522c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:8512:x1876028922299392:12345-0@lo:104: Request processed in 112us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120709.380937:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789120709.380969:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120709.380977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789120709.380991:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789120709.380997:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5906940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:8512:x1876028922299520:12345-0@lo:104: 00010000:00010000:3.0:1789120709.381010:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381024:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381035:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b000/0x13cfa3d77faa4c43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4c4a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120709.381045:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120709.381052:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5906940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:8512:x1876028922299520:12345-0@lo:104: Request processed in 59us (1854us total) trans 0 rc 0/0 00010000:00010000:2.0:1789120709.381055:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789120709.381061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789120709.381063:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381074:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8148a600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120709.381077:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381084:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120709.381103:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120709.381108:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120709.381126:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381132:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120709.381175:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381182:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148a600/0x13cfa3d77faa4b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b7f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381193:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120709.381196:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381202:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120709.381205:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.381211:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120709.381218:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120709.381231:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789120709.381302:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299392:0@lo:104: 00000100:00100000:1.0:1789120709.381312:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5904000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299520:0@lo:104: 00010000:00010000:0.0:1789120709.381363:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120709.381375:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120709.381397:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922299776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120709.381536:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120709.383328:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.383347:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120709.383373:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.383380:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4b16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4b1d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120709.383414:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120709.383417:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120709.383420:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120709.383439:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120709.383463:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922299648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120709.383553:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120709.383563:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d075e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922299904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120709.384038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120709.385663:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1876028922299136:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120709.385700:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.386730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299776 00000100:00100000:1.0:1789120709.386745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299776 00010000:00010000:1.0:1789120709.386796:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 19 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.386837:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299904 00000100:00100000:1.0:1789120709.386841:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299904 00010000:00010000:1.0:1789120709.386856:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 20 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.386875:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789120709.386885:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:3318:x1876028922299776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120709.386908:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120709.386915:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 20 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.386926:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 20 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.386968:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa4b7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4b78 expref: 20 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.386985:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120709.387050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922299776:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120709.387059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789120709.387082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789120709.387089:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922299904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120709.387097:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120709.387102:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387110:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387120:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa4b1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4b16 expref: 18 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387129:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120709.387781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120709.387792:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3317:x1876028922299904:12345-0@lo:103:ldlm_bl.0 Request processed in 702us (3754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120709.387803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789120709.387827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299840 00000100:00100000:1.0:1789120709.387833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299840 00010000:00010000:1.0:1789120709.387852:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120709.387868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789120709.387887:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901299840:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120709.387898:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120709.387904:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387915:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387927:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4d07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac63 expref: 10 pid: 5852 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120709.387937:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120709.387982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+9:2350:x1876028901299840:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120709.387988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789120709.388046:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d075e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922299904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120709.388178:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120709.388274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922299648 00000100:00100000:0.0:1789120709.388279:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922299648 00010000:00010000:0.0:1789120709.388299:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 17 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120709.388332:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789120709.388338:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3319:x1876028922299648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120709.388346:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120709.388351:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 17 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388361:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 17 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388373:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa4c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4c43 expref: 17 pid: 5852 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388386:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388396:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388412:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388419:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388425:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388502:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388509:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120709.388514:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388523:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388586:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120709.388598:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120709.388729:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120709.388741:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120709.388748:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4da8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120709.388757:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3319:x1876028922299648:12345-0@lo:103:ldlm_bl.0 Request processed in 417us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120709.388766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789120709.388922:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922299776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120709.388988:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922299648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120709.866471:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120710.895297:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789120711.022075:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120711.022081:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdbfb5a800 from 4 10000000:01000000:0.0:1789120711.022086:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120711.022127:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.022138:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.022165:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120711.022193:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120711.022250:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120711.022297:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.022410:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300032 00000100:00100000:1.0:1789120711.022417:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300032 00000100:00100000:1.0:1789120711.022466:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789120711.022476:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922300032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120711.022488:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120711.022998:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4daf expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.023025:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.023036:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.023052:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691c00, rc 0) 00000100:00100000:1.0:1789120711.023116:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 641us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.023124:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789120711.023190:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120711.023207:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.023217:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120711.023972:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d076580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120711.024009:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120711.024048:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.024181:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300160 00000100:00100000:1.0:1789120711.024188:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300160 00000100:00100000:1.0:1789120711.024232:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789120711.024241:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.025425:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1180us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.025438:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789120711.025617:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d076580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120711.026112:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120711.026198:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120711.026230:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.026452:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300288 00000100:00100000:1.0:1789120711.026458:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300288 00000100:00100000:1.0:1789120711.026503:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789120711.026513:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.026855:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.026864:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789120711.028654:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.030914:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8580:1876028922300416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120711.030994:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120711.031044:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb9437000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120711.031488:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300416 00000100:00100000:2.0:1789120711.031495:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300416 00000100:00100000:2.0:1789120711.031551:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789120711.031561:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8580:x1876028922300416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120711.031795:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8580:x1876028922300416:12345-0@lo:502:llog_process_th.0 Request processed in 234us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120711.031810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789120711.031867:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8580:1876028922300416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120711.031898:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120711.031913:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120711.031916:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120711.031922:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdbfb5a800 00000020:00000080:3.0:1789120711.031925:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120711.032006:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8580:1876028922300544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120711.032047:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120711.032087:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120711.034453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300544 00000100:00100000:2.0:1789120711.034466:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300544 00000100:00100000:2.0:1789120711.034528:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789120711.034537:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8580:x1876028922300544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120711.035204:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:8580:x1876028922300544:12345-0@lo:502:llog_process_th.0 Request processed in 666us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120711.035213:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120711.035593:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8580:1876028922300544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120711.035630:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120711.035638:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120711.035640:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789120711.035645:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789120711.037457:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789120711.037485:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120711.037496:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120711.037508:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120711.037530:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120711.037533:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaf537000 from 4 10000000:01000000:2.0:1789120711.037536:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120711.037569:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120711.037577:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120711.037587:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120711.037609:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120711.037674:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120711.037718:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.038199:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300672 00000100:00100000:1.0:1789120711.038208:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300672 00000100:00100000:1.0:1789120711.038260:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789120711.038270:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922300672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120711.038290:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120711.038303:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4dbd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.038427:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.038439:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.038448:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690e00, rc 0) 00000100:00100000:1.0:1789120711.038503:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922300672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.038510:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789120711.038550:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120711.038566:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120711.038574:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120711.038624:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120711.038652:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120711.038689:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.039382:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300800 00000100:00100000:1.0:1789120711.039388:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300800 00000100:00100000:1.0:1789120711.039426:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789120711.039435:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922300800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.039711:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922300800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.039719:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789120711.039916:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120711.040213:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120711.040261:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120711.040290:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.041332:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922300928 00000100:00100000:1.0:1789120711.041711:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922300928 00000100:00100000:1.0:1789120711.041758:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789120711.041766:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922300928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.041957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922300928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.041973:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789120711.042029:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d074b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922300928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120711.043833:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8584:1876028922301056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120711.043909:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120711.043961:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95487540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.044216:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301056 00000100:00100000:1.0:1789120711.044223:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301056 00000100:00100000:1.0:1789120711.044267:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789120711.044275:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8584:x1876028922301056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120711.044484:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8584:x1876028922301056:12345-0@lo:502:llog_process_th.0 Request processed in 209us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.044492:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789120711.044568:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8584:1876028922301056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120711.044601:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120711.044611:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120711.044614:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120711.044620:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdaf537000 00000020:00000080:3.0:1789120711.044624:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120711.044848:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8584:1876028922301184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120711.044897:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120711.044937:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120711.045247:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301184 00000100:00100000:0.0:1789120711.045254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301184 00000100:00100000:0.0:1789120711.045296:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789120711.045304:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8584:x1876028922301184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120711.045555:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8584:1876028922301184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120711.045581:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120711.045587:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120711.045589:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789120711.045593:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1789120711.045795:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:8584:x1876028922301184:12345-0@lo:502:llog_process_th.0 Request processed in 212us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120711.045806:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000020:01000000:1.0:1789120711.046304:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789120711.046325:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120711.046335:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.046347:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120711.046357:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120711.046359:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 4 10000000:01000000:1.0:1789120711.046362:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120711.046390:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.046398:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.046407:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120711.046438:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.046476:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120711.046558:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120711.046943:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301312 00000100:00100000:0.0:1789120711.046950:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301312 00000100:00100000:0.0:1789120711.047039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789120711.047049:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922301312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120711.047061:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120711.047085:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4dcb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.047108:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.047118:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120711.047126:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a200, rc 0) 00000100:00100000:0.0:1789120711.047197:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922301312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120711.047205:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789120711.047565:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120711.047580:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.047589:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120711.047710:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.047741:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120711.047772:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.047786:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301440 00000100:00100000:1.0:1789120711.047789:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301440 00000100:00100000:1.0:1789120711.047813:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789120711.047819:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922301440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.048244:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922301440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.048252:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789120711.048338:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120711.048371:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120711.048410:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120711.048430:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.048468:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301568 00000100:00100000:1.0:1789120711.048472:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301568 00000100:00100000:1.0:1789120711.048540:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789120711.048547:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922301568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.048690:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922301568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.048703:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789120711.053554:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922301568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.054024:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8585:1876028922301696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120711.055284:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120711.055327:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120711.055474:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301696 00000100:00100000:0.0:1789120711.055482:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301696 00000100:00100000:0.0:1789120711.055537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789120711.055547:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:8585:x1876028922301696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120711.056055:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:8585:x1876028922301696:12345-0@lo:502:llog_process_th.0 Request processed in 508us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120711.056064:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789120711.056402:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8585:1876028922301696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120711.056434:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120711.056444:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120711.056446:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789120711.056454:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd85287800 00000020:00000080:1.0:1789120711.056457:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789120711.056585:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8585:1876028922301824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120711.056626:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120711.056733:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301824 00000100:00100000:1.0:1789120711.056738:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301824 00000100:00100000:1.0:1789120711.056777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789120711.056785:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:8585:x1876028922301824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120711.057007:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:8585:x1876028922301824:12345-0@lo:502:llog_process_th.0 Request processed in 222us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.057015:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789120711.057057:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120711.057166:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:8585:1876028922301824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120711.057188:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120711.057193:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120711.057195:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789120711.057203:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789120711.057254:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789120711.057270:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120711.057279:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.057289:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120711.216187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120711.216273:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901299968 00000100:00100000:1.0:1789120711.216291:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901299968 00000100:00100000:1.0:1789120711.216353:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:1.0:1789120711.216363:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+9:5591:x1876028901299968:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120711.216379:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120711.216396:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aca2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.216421:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.216431:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120711.216439:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691000, rc 0) 00000100:00100000:1.0:1789120711.216498:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901299968:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 136us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.216506:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:0.0:1789120711.226196:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120711.226280:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300096 00000100:00100000:1.0:1789120711.226290:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300096 00000100:00100000:1.0:1789120711.226363:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:1.0:1789120711.226373:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901300096:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.227362:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901300096:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 987us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.227373:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:3.0:1789120711.236053:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120711.236226:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300224 00000100:00100000:1.0:1789120711.236235:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300224 00000100:00100000:1.0:1789120711.236289:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:1.0:1789120711.236299:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901300224:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120711.236540:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:5591:x1876028901300224:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 241us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.236549:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:2.0:1789120711.251588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120711.251736:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300352 00000100:00100000:1.0:1789120711.251746:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300352 00000100:00100000:1.0:1789120711.251794:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 191 00000100:00100000:1.0:1789120711.251804:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:6128:x1876028901300352:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120711.252024:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:6128:x1876028901300352:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 220us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120711.252033:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 191 00000100:00100000:1.0:1789120711.258664:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120711.258746:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300480 00000100:00100000:3.0:1789120711.258756:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300480 00000100:00100000:3.0:1789120711.258823:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 192 00000100:00100000:3.0:1789120711.258832:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:6128:x1876028901300480:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120711.259058:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:6128:x1876028901300480:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 226us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120711.259080:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 192 00010000:00010000:0.0:1789120711.916473:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120712.938347:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120712.938479:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922301952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120712.938558:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120712.940085:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922301952 00000100:00100000:0.0:1789120712.940098:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922301952 00000100:00100000:0.0:1789120712.940178:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120712.940187:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922301952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120712.940222:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120712.940288:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922301952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1729us total) trans 0 rc 0/0 00000100:00080000:1.0:1789120712.940599:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120712.940879:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789120712.940925:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54df840 x1876028922301952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120712.940945:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922301952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120713.650121:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120713.650352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120713.650459:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300608 00000100:00100000:1.0:1789120713.650468:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300608 00000100:00100000:1.0:1789120713.650531:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:1.0:1789120713.650542:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901300608:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120713.651368:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300864 00000100:00100000:1.0:1789120713.651372:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901300608:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 829us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120713.651374:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300864 00000100:00100000:1.0:1789120713.651381:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:0.0:1789120713.651416:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789120713.651424:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901300864:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120713.651456:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901300864:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 33us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120713.651463:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:2.0:1789120713.651475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00080000:0.0:1789120713.651493:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120713.651518:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300736 00000100:00100000:0.0:1789120713.651522:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300736 00000100:00100000:2.0:1789120713.651555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120713.651563:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789120713.651568:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901300736:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120713.651597:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901300736:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 29us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120713.651603:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789120713.651621:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901300992 00000100:00100000:0.0:1789120713.651625:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901300992 00000100:00100000:0.0:1789120713.651645:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789120713.651651:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901300992:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120713.651686:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901300992:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120713.651692:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00080000:0.0:1789120713.651704:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120713.651707:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789120713.974842:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120714.475734:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922302080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.475799:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.475842:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922302592:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.475970:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.475998:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120714.476004:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922302464:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476029:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.476070:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5904780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922302208:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.476109:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922302720:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476128:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.476174:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120714.476180:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922302336:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476203:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120714.476233:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302080 00000100:00100000:1.0:1789120714.476240:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302080 00000100:00100000:1.0:1789120714.476279:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789120714.476287:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922302080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476332:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922302080:12345-0@lo:400:kworker.0 Request processed in 45us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.476339:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789120714.476372:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302592 00000100:00100000:1.0:1789120714.476385:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302592 00000100:00100000:1.0:1789120714.476421:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302208 00000100:00100000:1.0:1789120714.476424:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302208 00000100:00100000:1.0:1789120714.476437:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302336 00000100:00100000:1.0:1789120714.476440:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302336 00000100:00100000:1.0:1789120714.476454:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789120714.476460:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922302592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476492:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922302592:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.476509:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789120714.476522:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120714.476528:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5907c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922302208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476562:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5907c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922302208:12345-0@lo:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.476568:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120714.476581:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789120714.476587:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922302336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.476613:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922302336:12345-0@lo:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.476618:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789120714.476638:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302464 00000100:00100000:1.0:1789120714.476641:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302464 00000100:00100000:1.0:1789120714.477101:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302720 00000100:00100000:1.0:1789120714.477106:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302720 00000100:00100000:1.0:1789120714.477134:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120714.477140:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922302464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.477194:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922302464:12345-0@lo:400:kworker.0 Request processed in 54us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.477209:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120714.477223:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789120714.477229:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922302720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.477259:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922302720:12345-0@lo:400:kworker.0 Request processed in 31us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120714.477265:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789120714.477306:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120714.477311:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120714.477313:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120714.477344:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922302336:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.477355:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5904780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922302208:0@lo:400:kworker.0 00010000:00080000:1.0:1789120714.477367:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5906d00 x1876028922302720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120714.477376:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5906d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922302720:0@lo:400:kworker.0 00010000:00080000:1.0:1789120714.477407:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5905680 x1876028922302464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120714.477415:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922302464:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.477423:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922302080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120714.477433:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922302592:0@lo:400:kworker.0 00000100:00100000:0.0:1789120714.482365:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120714.482389:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922302848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120714.482457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120714.482507:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302848 00000100:00100000:0.0:1789120714.482514:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302848 00000100:00100000:0.0:1789120714.482558:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120714.482566:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922302848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120714.482602:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120714.482640:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922302848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120714.482647:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789120714.482824:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6c3c0 x1876028922302848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120714.482841:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922302848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789120714.988467:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120715.530387:0:8813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789120716.011353:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120717.036885:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120718.058771:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120718.058792:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120718.058858:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120718.059003:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922302976 00000100:00100000:3.0:1789120718.059010:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922302976 00000100:00100000:3.0:1789120718.059330:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120718.059339:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922302976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120718.059369:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120718.059409:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922302976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120718.059416:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789120718.059435:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789120718.059468:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54dc780 x1876028922302976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120718.059497:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922302976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789120718.059735:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120718.774969:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120718.775003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120718.775023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120718.775048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120718.775076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301120 00000100:00100000:0.0:1789120718.775084:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301120 00000100:00100000:0.0:1789120718.775129:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:0.0:1789120718.775139:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901301120:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120718.775220:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901301120:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120718.775227:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:0.0:1789120718.775708:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301376 00000100:00100000:0.0:1789120718.775713:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301376 00000100:00100000:0.0:1789120718.775750:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301504 00000100:00100000:0.0:1789120718.775753:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301504 00000100:00100000:0.0:1789120718.775791:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789120718.775800:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901301376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120718.775833:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901301376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120718.775839:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789120718.775852:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789120718.775868:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901301504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120718.775894:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901301504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 27us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120718.775899:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789120718.775918:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301248 00000100:00100000:0.0:1789120718.775922:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301248 00000100:00100000:0.0:1789120718.775950:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:0.0:1789120718.775957:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901301248:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120718.775986:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901301248:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120718.775991:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00080000:0.0:1789120718.776114:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120718.776119:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120718.776121:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789120719.082548:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120719.594372:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120719.594449:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120719.597129:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120719.597223:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120719.597276:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120719.597283:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922303488:0@lo:400:kworker.0 00000100:00100000:2.0:1789120719.597343:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303616 00000100:00100000:2.0:1789120719.597352:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303616 00000100:00100000:2.0:1789120719.597413:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789120719.597422:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922303616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120719.597454:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789120719.597461:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120719.597523:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922303616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120719.597532:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120719.597660:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303104 00000100:00100000:1.0:1789120719.597664:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303104 00000100:00100000:1.0:1789120719.597696:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789120719.597704:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922303104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.597751:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922303104:12345-0@lo:400:kworker.0 Request processed in 48us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120719.597758:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789120719.597792:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922303232:0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.597818:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120719.598128:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922303744:0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598177:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120719.598199:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120719.598206:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922303360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598229:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120719.598263:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303232 00000100:00100000:1.0:1789120719.598267:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303232 00000100:00100000:1.0:1789120719.598310:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303744 00000100:00100000:1.0:1789120719.598314:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303744 00000100:00100000:1.0:1789120719.598341:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303360 00000100:00100000:1.0:1789120719.598345:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303360 00000100:00100000:1.0:1789120719.598363:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789120719.598371:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922303232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598411:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922303232:12345-0@lo:400:kworker.0 Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120719.598417:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789120719.598432:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789120719.598439:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5906d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922303744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598483:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5906d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922303744:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120719.598490:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789120719.598520:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789120719.598528:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598559:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922303360:12345-0@lo:400:kworker.0 Request processed in 33us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120719.598565:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789120719.598613:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922303360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598625:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922303232:0@lo:400:kworker.0 00000100:00100000:1.0:1789120719.598633:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922303744:0@lo:400:kworker.0 00000100:00080000:2.0:1789120719.599091:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120719.599096:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789120719.602350:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6cb40 x1876028922303616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120719.602375:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120719.602387:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120719.602452:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303488 00000100:00100000:3.0:1789120719.602460:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303488 00000100:00100000:3.0:1789120719.602601:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120719.602611:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120719.602702:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922303488:12345-0@lo:400:kworker.0 Request processed in 93us (5249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120719.602710:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789120719.602767:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5907840 x1876028922303488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120719.602778:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922303488:0@lo:400:kworker.0 00000001:02000400:2.0:1789120719.950109:0:9057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing yml_node 00010000:00010000:0.0:1789120720.113693:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120721.132517:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120722.154896:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120723.179382:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922303872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120723.179474:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120723.179633:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120723.182284:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922303872 00000100:00100000:0.0:1789120723.182297:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922303872 00000100:00100000:0.0:1789120723.182371:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789120723.182380:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922303872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120723.182422:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789120723.182479:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789120723.182532:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6e580 x1876028922303872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120723.182551:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922303872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120723.182805:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922303872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 425us (3329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120723.182815:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789120723.896186:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120723.896231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120723.896661:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301632 00000100:00100000:0.0:1789120723.896689:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301632 00000100:00100000:0.0:1789120723.896770:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:0.0:1789120723.896780:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901301632:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120723.896856:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901301632:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 77us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120723.896867:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:2.0:1789120723.896912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120723.896992:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301760 00000100:00100000:1.0:1789120723.896998:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301760 00000100:00100000:1.0:1789120723.897048:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789120723.897056:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901301760:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120723.897091:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901301760:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120723.897097:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00080000:2.0:1789120723.897133:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120723.899575:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901301888 00000100:00100000:1.0:1789120723.899586:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901301888 00000100:00100000:1.0:1789120723.900706:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120723.900718:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2348:x1876028901301888:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:1.0:1789120723.900756:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4d15 00000100:00080000:1.0:1789120723.900778:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789120723.900814:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789120723.901127:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+2:2348:x1876028901301888:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 409us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120723.901135:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00010000:00010000:1.0:1789120723.901180:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120723.902208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00080000:3.0:1789120723.902549:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120723.902645:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302016 00000100:00100000:1.0:1789120723.902652:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302016 00000100:00100000:1.0:1789120723.902704:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789120723.902713:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2348:x1876028901302016:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:1.0:1789120723.902743:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4d1c 00000100:00080000:1.0:1789120723.902752:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789120723.902786:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789120723.904788:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+2:2348:x1876028901302016:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 2068us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120723.904799:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00010000:00010000:1.0:1789120723.904835:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120723.904871:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1789120724.085672:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.139 00010000:00010000:1.0:1789120724.203656:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120724.714417:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922304000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.714435:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922304256:0@lo:400:kworker.0 00000100:00100000:3.0:1789120724.715058:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.722080:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120724.722178:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120724.722190:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922304384:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.722229:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120724.722278:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304256 00000100:00100000:1.0:1789120724.722285:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304256 00000100:00100000:1.0:1789120724.722336:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789120724.722345:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922304256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.722406:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922304256:12345-0@lo:400:kworker.0 Request processed in 62us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.722413:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789120724.722438:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304384 00000100:00100000:1.0:1789120724.722453:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304384 00000100:00100000:1.0:1789120724.722480:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120724.722486:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922304384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.722518:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922304384:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.722524:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789120724.722541:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120724.722601:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120724.722638:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922304512:0@lo:400:kworker.0 00000100:00100000:2.0:1789120724.722664:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120724.722824:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304000 00000100:00100000:1.0:1789120724.722829:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304000 00000100:00100000:1.0:1789120724.722864:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789120724.722870:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.722908:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922304000:12345-0@lo:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.722913:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789120724.722935:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304512 00000100:00100000:1.0:1789120724.722938:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304512 00000100:00100000:1.0:1789120724.722961:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120724.722967:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922304512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723057:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922304512:12345-0@lo:400:kworker.0 Request processed in 90us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.723064:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120724.723082:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120724.723090:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d076580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922304768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120724.723124:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120724.723170:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304768 00000100:00100000:1.0:1789120724.723174:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304768 00000100:00100000:1.0:1789120724.723199:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789120724.723205:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922304768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120724.723228:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120724.723258:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922304768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.723264:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789120724.723279:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120724.723282:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789120724.723301:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd9d076580 x1876028922304768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120724.723317:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d076580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922304768:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789120724.723341:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f65e00 x1876028922304384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120724.723350:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922304384:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723359:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922304256:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723390:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922304512:0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723399:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922304000:0@lo:400:kworker.0 00000100:00100000:3.0:1789120724.723521:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120724.723548:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922304640:0@lo:400:kworker.0 00000100:00100000:3.0:1789120724.723578:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120724.723701:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304640 00000100:00100000:1.0:1789120724.723705:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304640 00000100:00100000:1.0:1789120724.723738:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120724.723745:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723851:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922304640:12345-0@lo:400:kworker.0 Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.723857:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120724.723877:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304128 00000100:00100000:1.0:1789120724.723880:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304128 00000100:00100000:1.0:1789120724.723901:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120724.723906:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922304128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120724.723934:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922304128:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120724.723939:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120724.724687:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922304128:0@lo:400:kworker.0 00010000:00080000:3.0:1789120724.724701:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f66580 x1876028922304640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120724.724712:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922304640:0@lo:400:kworker.0 00010000:00010000:1.0:1789120725.231314:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120726.251423:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120726.558675:0:9346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.139 00010000:00010000:3.0:1789120727.276385:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120728.298314:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120728.302591:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922304896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120728.302658:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120728.304636:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922304896 00000100:00100000:0.0:1789120728.304648:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922304896 00000100:00100000:0.0:1789120728.304702:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120728.304712:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922304896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120728.304744:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120728.304810:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d075a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922304896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120728.304817:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789120728.304853:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6e580 x1876028922304896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120728.304872:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922304896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789120728.306676:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789120728.347727:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:0.0:1789120728.347735:0:6729:0:(genops.c:885:class_export_put()) final put ffff9ffdb990f800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:0.0:1789120728.347762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb990f800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-OST0000 00000020:00000080:0.0:1789120728.347812:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb990f000 for lustre-OST0000 00000001:00100000:1.0:1789120728.384115:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:1.0:1789120728.384124:0:7651:0:(genops.c:885:class_export_put()) final put ffff9ffdb990c800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:0.0:1789120728.384429:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb990c800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-OST0001 00000020:00000080:0.0:1789120728.384482:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb990b000 for lustre-OST0001 00000100:00100000:3.0:1789120729.014424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120729.014483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120729.014544:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302144 00000100:00100000:3.0:1789120729.014565:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302144 00000100:00100000:3.0:1789120729.014636:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:3.0:1789120729.014651:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2351:x1876028901302144:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120729.014745:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2351:x1876028901302144:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120729.014754:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:1.0:1789120729.017052:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302272 00000100:00100000:1.0:1789120729.017071:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302272 00000100:00100000:1.0:1789120729.017193:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:1.0:1789120729.017205:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901302272:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120729.017307:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901302272:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 105us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.017315:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00080000:1.0:1789120729.017350:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789120729.181499:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.139 00010000:00010000:3.0:1789120729.322569:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120729.835959:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922305280:0@lo:400:kworker.0 00000100:00100000:0.0:1789120729.836089:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120729.836238:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120729.836245:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922305408:0@lo:400:kworker.0 00000100:00100000:0.0:1789120729.836277:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120729.836563:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922305024:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.836606:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120729.836654:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922305536:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.836681:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120729.836714:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789120729.836720:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.836742:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120729.836756:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922305664:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.836776:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120729.836807:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305280 00000100:00100000:1.0:1789120729.836815:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305280 00000100:00100000:1.0:1789120729.836873:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305536 00000100:00100000:1.0:1789120729.836876:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305536 00000100:00100000:1.0:1789120729.836900:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305152 00000100:00100000:1.0:1789120729.836903:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305152 00000100:00100000:1.0:1789120729.836918:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120729.836925:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922305280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.836982:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922305280:12345-0@lo:400:kworker.0 Request processed in 56us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.836989:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120729.837007:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120729.837012:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922305536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837042:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922305536:12345-0@lo:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.837048:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120729.837060:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789120729.837066:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922305152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837094:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922305152:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.837110:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789120729.837132:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305408 00000100:00100000:1.0:1789120729.837137:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305408 00000100:00100000:1.0:1789120729.837187:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305664 00000100:00100000:1.0:1789120729.837190:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305664 00000100:00100000:1.0:1789120729.837212:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120729.837219:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922305408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837253:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922305408:12345-0@lo:400:kworker.0 Request processed in 34us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.837271:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120729.837283:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789120729.837289:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922305664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837317:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922305664:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120729.837322:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789120729.837349:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120729.837355:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120729.837396:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922305152:0@lo:400:kworker.0 00010000:00080000:1.0:1789120729.837421:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd989743c0 x1876028922305664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120729.837433:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922305664:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837445:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922305536:0@lo:400:kworker.0 00010000:00080000:1.0:1789120729.837484:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6d680 x1876028922305408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120729.837494:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922305408:0@lo:400:kworker.0 00000100:00100000:1.0:1789120729.837515:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922305280:0@lo:400:kworker.0 00000100:00100000:0.0:1789120729.837916:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305024 00000100:00100000:0.0:1789120729.837923:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305024 00000100:00100000:0.0:1789120729.837972:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789120729.837980:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120729.838041:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922305024:12345-0@lo:400:kworker.0 Request processed in 61us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120729.838048:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789120729.838438:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922305024:0@lo:400:kworker.0 00000100:00100000:0.0:1789120729.840673:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120729.840708:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922305792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120729.840799:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120729.840897:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305792 00000100:00100000:2.0:1789120729.840907:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305792 00000100:00100000:2.0:1789120729.840971:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789120729.840983:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922305792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120729.841029:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120729.841089:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922305792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120729.841097:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789120729.841603:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd9d0761c0 x1876028922305792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120729.841626:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922305792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789120730.348253:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120730.742738:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 05:58:49 EDT 2026 00010000:00010000:3.0:1789120731.370788:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120732.394410:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120733.421291:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922305920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120733.421385:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120733.421500:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922305920 00000100:00100000:0.0:1789120733.421509:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922305920 00000100:00100000:0.0:1789120733.421571:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789120733.421581:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922305920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120733.421623:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120733.421674:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922305920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120733.421682:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789120733.422036:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd90642940 x1876028922305920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120733.422057:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922305920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789120733.423564:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789120733.424104:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120734.131516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120734.131574:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120734.131614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302400 00000100:00100000:3.0:1789120734.131623:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302400 00000100:00100000:3.0:1789120734.131686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:3.0:1789120734.131699:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901302400:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120734.131775:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2350:x1876028901302400:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120734.131784:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:1.0:1789120734.133639:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302528 00000100:00100000:1.0:1789120734.133651:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302528 00000100:00100000:1.0:1789120734.133724:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:1.0:1789120734.133736:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901302528:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120734.133806:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901302528:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 73us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.133814:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00080000:2.0:1789120734.134582:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120734.442723:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120734.954512:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922306304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120734.954587:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120734.954656:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120734.954662:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922306432:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.954787:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922306048:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.954821:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120734.954849:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922306560:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.954871:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120734.954889:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789120734.954893:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922306176:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.954911:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120734.954923:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922306688:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.954946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306048 00000100:00100000:1.0:1789120734.954952:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306048 00000100:00100000:1.0:1789120734.954988:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789120734.954995:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922306048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.955038:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922306048:12345-0@lo:400:kworker.0 Request processed in 42us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.955056:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789120734.955087:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306304 00000100:00100000:1.0:1789120734.955091:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306304 00000100:00100000:1.0:1789120734.955123:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306560 00000100:00100000:1.0:1789120734.955126:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306560 00000100:00100000:1.0:1789120734.955138:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306176 00000100:00100000:1.0:1789120734.955140:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306176 00000100:00100000:1.0:1789120734.955182:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120734.955187:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922306304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.955216:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922306304:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.955222:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120734.955233:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120734.955238:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922306560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.955261:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922306560:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.955266:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120734.955276:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120734.955281:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922306176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.955304:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922306176:12345-0@lo:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.955309:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789120734.955326:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120734.955478:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120734.955534:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922306304:0@lo:400:kworker.0 00000100:00100000:0.0:1789120734.955611:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120734.955645:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922306048:0@lo:400:kworker.0 00000100:00100000:0.0:1789120734.955655:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922306560:0@lo:400:kworker.0 00000100:00100000:0.0:1789120734.955673:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922306176:0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.956408:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306432 00000100:00100000:1.0:1789120734.956415:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306432 00000100:00100000:1.0:1789120734.956455:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306688 00000100:00100000:1.0:1789120734.956458:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306688 00000100:00100000:1.0:1789120734.956494:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120734.956500:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922306432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.956549:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922306432:12345-0@lo:400:kworker.0 Request processed in 49us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.956568:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120734.956582:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789120734.956588:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922306688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120734.956620:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922306688:12345-0@lo:400:kworker.0 Request processed in 33us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120734.956626:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789120734.956643:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120734.956826:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54ded00 x1876028922306432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120734.956838:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922306432:0@lo:400:kworker.0 00010000:00080000:0.0:1789120734.956917:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54dcf00 x1876028922306688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120734.956926:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922306688:0@lo:400:kworker.0 00000100:00100000:0.0:1789120734.960935:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120734.960958:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922306816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120734.961019:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120734.961109:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306816 00000100:00100000:2.0:1789120734.961116:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306816 00000100:00100000:2.0:1789120734.961183:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120734.961192:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922306816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120734.961223:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120734.961271:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922306816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120734.961277:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789120734.961600:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd9d0761c0 x1876028922306816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120734.961617:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922306816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789120735.466645:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120736.490307:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120737.516550:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120738.539497:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922306944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120738.539564:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120738.539658:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922306944 00000100:00100000:3.0:1789120738.539665:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922306944 00000100:00100000:3.0:1789120738.539727:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789120738.539735:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922306944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120738.539777:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120738.539826:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922306944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120738.539835:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789120738.539883:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54ded00 x1876028922306944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120738.539908:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922306944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789120738.539937:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789120738.540059:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120739.250324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120739.250438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120739.250485:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302784 00000100:00100000:0.0:1789120739.250498:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302784 00000100:00100000:0.0:1789120739.250588:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789120739.250599:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901302784:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120739.250690:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901302784:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120739.250714:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00080000:0.0:1789120739.250743:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120739.256276:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302656 00000100:00100000:2.0:1789120739.256295:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302656 00000100:00100000:2.0:1789120739.258200:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:2.0:1789120739.258225:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901302656:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120739.258344:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901302656:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 129us (8035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120739.258354:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 203 00010000:00010000:1.0:1789120739.570928:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120740.075534:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922307584:0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.075534:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922307328:0@lo:400:kworker.0 00000100:00100000:1.0:1789120740.075593:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d075e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922307200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120740.082478:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120740.082563:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120740.082660:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120740.082675:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922307456:0@lo:400:kworker.0 00000100:00100000:2.0:1789120740.082728:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307584 00000100:00100000:2.0:1789120740.082737:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307584 00000100:00100000:2.0:1789120740.082805:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789120740.082815:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922307584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.083225:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922307840:0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.083253:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120740.083303:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307840 00000100:00100000:0.0:1789120740.083307:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307840 00000100:00100000:0.0:1789120740.083338:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789120740.083344:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922307840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.083409:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922307840:12345-0@lo:400:kworker.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120740.083416:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789120740.083468:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd90641680 x1876028922307840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120740.083484:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90641680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922307840:0@lo:400:kworker.0 00000100:00100000:1.0:1789120740.083624:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120740.083677:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd906412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922307072:0@lo:400:kworker.0 00000100:00100000:1.0:1789120740.083710:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120740.083733:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922307712:0@lo:400:kworker.0 00000100:00100000:1.0:1789120740.083757:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120740.083826:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922307584:12345-0@lo:400:kworker.0 Request processed in 1013us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120740.083833:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789120740.083871:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120740.083876:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120740.084173:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307200 00000100:00100000:0.0:1789120740.084179:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307200 00000100:00100000:0.0:1789120740.084212:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120740.084219:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922307200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120740.084252:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120740.084288:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922307200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120740.084295:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789120740.086002:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd9d075e00 x1876028922307200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120740.086033:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d075e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922307200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120740.086071:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307072 00000100:00100000:1.0:1789120740.086078:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307072 00000100:00100000:1.0:1789120740.086136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789120740.086201:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922307072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120740.086278:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922307072:12345-0@lo:400:kworker.0 Request processed in 80us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120740.086286:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789120740.086346:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd906412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922307072:0@lo:400:kworker.0 00000100:00100000:2.0:1789120740.086588:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120740.086808:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307328 00000100:00100000:3.0:1789120740.086816:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307328 00000100:00100000:3.0:1789120740.087464:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307712 00000100:00100000:3.0:1789120740.087470:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307712 00000100:00100000:0.0:1789120740.087563:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789120740.087590:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922307328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.087688:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922307328:12345-0@lo:400:kworker.0 Request processed in 101us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120740.087696:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789120740.087716:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120740.087722:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922307712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.087758:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922307712:12345-0@lo:400:kworker.0 Request processed in 36us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120740.087764:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120740.095093:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307456 00000100:00100000:0.0:1789120740.095390:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307456 00000100:00100000:0.0:1789120740.095520:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120740.095534:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.095660:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922307456:12345-0@lo:400:kworker.0 Request processed in 130us (9072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120740.095668:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120740.095780:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922307456:0@lo:400:kworker.0 00010000:00080000:2.0:1789120740.095801:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd90640780 x1876028922307584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120740.095811:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90640780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922307584:0@lo:400:kworker.0 00000100:00080000:2.0:1789120740.095883:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120740.097131:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922307328:0@lo:400:kworker.0 00000100:00100000:0.0:1789120740.098383:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922307712:0@lo:400:kworker.0 00010000:00010000:1.0:1789120740.588311:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120741.610949:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120742.644385:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120743.659485:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120743.660571:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120743.660589:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922307968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120743.660665:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120743.660748:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922307968 00000100:00100000:0.0:1789120743.660756:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922307968 00000100:00100000:0.0:1789120743.660814:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789120743.660824:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922307968:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789120743.660830:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789120743.660873:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120743.660917:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922307968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120743.660924:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789120743.660960:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd906403c0 x1876028922307968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120743.660977:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922307968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120744.372096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120744.372191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120744.372286:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901302912 00000100:00100000:2.0:1789120744.372295:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901302912 00000100:00100000:2.0:1789120744.372356:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:2.0:1789120744.372365:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901302912:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120744.372440:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901302912:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120744.372448:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:3.0:1789120744.375105:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303040 00000100:00100000:3.0:1789120744.375134:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303040 00000100:00100000:3.0:1789120744.375323:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789120744.375364:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901303040:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120744.375881:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901303040:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 543us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120744.375911:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00080000:2.0:1789120744.376081:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120744.689434:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789120745.098984:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:59:03 (1789120743) === 00000100:00100000:0.0:1789120745.194621:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922308096:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.194727:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.194799:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922308608:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.194830:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.194864:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120745.194869:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922308480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.194899:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.194928:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922308224:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.194955:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.194972:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922308736:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.194993:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.195012:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120745.195019:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922308352:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195043:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.195082:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308608 00000100:00100000:0.0:1789120745.195103:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308608 00000100:00100000:0.0:1789120745.195216:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308224 00000100:00100000:0.0:1789120745.195220:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308224 00000100:00100000:0.0:1789120745.195234:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308352 00000100:00100000:0.0:1789120745.195236:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308352 00000100:00100000:0.0:1789120745.195255:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120745.195265:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922308608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195351:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922308608:12345-0@lo:400:kworker.0 Request processed in 87us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.195358:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120745.195380:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120745.195386:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922308224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195420:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922308224:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.195425:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120745.195436:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120745.195455:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922308352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195485:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922308352:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.195491:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120745.195514:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308480 00000100:00100000:0.0:1789120745.195518:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308480 00000100:00100000:0.0:1789120745.195549:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308736 00000100:00100000:0.0:1789120745.195552:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308736 00000100:00100000:0.0:1789120745.195574:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120745.195580:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922308480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195612:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922308480:12345-0@lo:400:kworker.0 Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.195630:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120745.195642:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789120745.195648:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922308736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195677:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922308736:12345-0@lo:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.195684:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789120745.195709:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120745.195713:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120745.195716:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120745.195759:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922308352:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195772:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922308224:0@lo:400:kworker.0 00010000:00080000:0.0:1789120745.195785:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f65e00 x1876028922308736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120745.195796:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922308736:0@lo:400:kworker.0 00010000:00080000:0.0:1789120745.195838:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f66580 x1876028922308480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120745.195848:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922308480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120745.195859:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922308608:0@lo:400:kworker.0 00000100:00100000:1.0:1789120745.196420:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308096 00000100:00100000:1.0:1789120745.196427:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308096 00000100:00100000:2.0:1789120745.196709:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789120745.196722:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922308096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120745.196793:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922308096:12345-0@lo:400:kworker.0 Request processed in 74us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.196801:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789120745.196925:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120745.196967:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120745.197035:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5907840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922308096:0@lo:400:kworker.0 00000100:00100000:2.0:1789120745.197090:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308864 00000100:00100000:2.0:1789120745.197095:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308864 00000100:00100000:2.0:1789120745.197131:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789120745.197139:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922308864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120745.197202:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120745.197249:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922308864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.197255:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789120745.197354:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdbfb6e580 x1876028922308864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120745.197374:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120745.587619:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120745.587769:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303168 00000100:00100000:1.0:1789120745.587782:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303168 00000100:00100000:1.0:1789120745.587862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:1.0:1789120745.587874:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+10:8123:x1876028901303168:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120745.587904:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120745.587927:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa4de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aca9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.587964:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa4de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.587976:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa4de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca9 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.587996:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99baa00, rc 0) 00000100:00100000:1.0:1789120745.588072:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303168:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 201us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.588080:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:1.0:1789120745.590268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120745.590672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303296 00000100:00100000:0.0:1789120745.590685:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303296 00000100:00100000:0.0:1789120745.590755:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:0.0:1789120745.590768:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303296:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120745.591727:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303296:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 953us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.591740:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:0.0:1789120745.601698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.601985:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303424 00000100:00100000:2.0:1789120745.601999:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303424 00000100:00100000:2.0:1789120745.602074:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:2.0:1789120745.602086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303424:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789120745.602475:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303424:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 390us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.602485:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:2.0:1789120745.607871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120745.608632:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303552 00000100:00100000:0.0:1789120745.608649:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303552 00000100:00100000:0.0:1789120745.608733:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:0.0:1789120745.608747:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8127:x1876028901303552:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120745.610026:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8127:x1876028901303552:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 1270us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.610042:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:1.0:1789120745.635467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.635767:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303680 00000100:00100000:2.0:1789120745.635781:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303680 00000100:00100000:2.0:1789120745.635861:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:2.0:1789120745.635886:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8127:x1876028901303680:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120745.636523:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8127:x1876028901303680:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 649us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.636535:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:2.0:1789120745.646757:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120745.646907:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303808 00000100:00100000:1.0:1789120745.646922:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303808 00000100:00100000:1.0:1789120745.647001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:1.0:1789120745.647013:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+11:8123:x1876028901303808:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120745.647036:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120745.647060:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99ba200/0x13cfa3d77faa4de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8acd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.647100:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99ba200/0x13cfa3d77faa4de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acd3 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.647112:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99ba200/0x13cfa3d77faa4de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acd3 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.647124:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba200, rc 0) 00000100:00100000:1.0:1789120745.647241:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:8123:x1876028901303808:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 231us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.647250:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:0.0:1789120745.658554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.658676:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901303936 00000100:00100000:2.0:1789120745.658690:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901303936 00000100:00100000:2.0:1789120745.658762:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:2.0:1789120745.658775:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:8123:x1876028901303936:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789120745.658818:0:5850:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789120745.658864:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789120745.658869:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789120745.658883:0:5850:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789120745.658886:0:5850:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789120745.661235:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:8123:x1876028901303936:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 2446us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.661254:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:3.0:1789120745.667649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120745.668033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304064 00000100:00100000:1.0:1789120745.668046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304064 00000100:00100000:1.0:1789120745.668138:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:1.0:1789120745.668186:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:8123:x1876028901304064:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120745.668208:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120745.668230:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8acda expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.668265:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.668278:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120745.668288:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bbe00, rc 0) 00000100:00100000:1.0:1789120745.668381:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8123:x1876028901304064:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 198us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.668389:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:0.0:1789120745.674240:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.674401:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304192 00000100:00100000:2.0:1789120745.674540:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304192 00000100:00100000:2.0:1789120745.674634:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:2.0:1789120745.674646:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8123:x1876028901304192:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789120745.675590:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8123:x1876028901304192:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 941us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.675602:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:3.0:1789120745.679259:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120745.679461:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304320 00000100:00100000:0.0:1789120745.679474:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304320 00000100:00100000:0.0:1789120745.679544:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:0.0:1789120745.679557:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8123:x1876028901304320:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789120745.679858:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8123:x1876028901304320:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 303us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.679868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:2.0:1789120745.683608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120745.683753:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304448 00000100:00100000:3.0:1789120745.683766:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304448 00000100:00100000:3.0:1789120745.683837:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:3.0:1789120745.683850:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8130:x1876028901304448:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120745.684229:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8130:x1876028901304448:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 380us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120745.684239:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:2.0:1789120745.693349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120745.694080:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304576 00000100:00100000:1.0:1789120745.694096:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304576 00000100:00100000:1.0:1789120745.694346:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:1.0:1789120745.694362:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8130:x1876028901304576:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120745.694722:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:8130:x1876028901304576:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 363us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.694732:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:2.0:1789120745.705001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.705182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120745.706897:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305088 00000100:00100000:0.0:1789120745.706914:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305088 00010000:00010000:3.0:1789120745.707031:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120745.707100:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304704 00000100:00100000:0.0:1789120745.707105:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304704 00000100:00100000:2.0:1789120745.707189:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:2.0:1789120745.707204:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901305088:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120745.707671:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901305088:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 470us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.712836:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120745.712856:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd989743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1876028901304704:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789120745.712910:0:5857:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 62440a6e-232c-434d-8868-70f19c1fd072@192.168.206.9@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1789120745.713005:0:5857:0:(genops.c:1385:class_connect()) connect: client 62440a6e-232c-434d-8868-70f19c1fd072, cookie 0x13cfa3d77faa4df5 00000004:00100000:1.0:1789120745.713048:0:5857:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789120745.713078:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00080000:1.0:1789120745.713414:0:5857:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d398000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120745.713668:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd989743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+6:2348:x1876028901304704:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 814us (8484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.713678:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789120745.720037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.720090:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120745.721085:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304960 00000100:00100000:3.0:1789120745.721101:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304960 00000100:00100000:3.0:1789120745.721243:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901304832 00000100:00100000:3.0:1789120745.721247:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901304832 00000100:00100000:3.0:1789120745.721269:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789120745.721282:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+7:8123:x1876028901304960:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789120745.721344:0:8217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789120745.721461:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+7:8123:x1876028901304960:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 183us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120745.721470:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789120745.721490:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:3.0:1789120745.721497:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9507840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:0:x1876028901304832:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789120745.721509:0:8217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789120745.721564:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9507840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:0:x1876028901304832:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 66us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120745.721571:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00080000:2.0:1789120745.721838:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120745.727448:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120745.727550:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305216 00000100:00100000:3.0:1789120745.727562:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305216 00000100:00100000:3.0:1789120745.727638:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120745.727650:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:8123:x1876028901305216:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789120745.727780:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:8123:x1876028901305216:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 131us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120745.727788:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120745.730093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120745.730245:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305600 00000100:00100000:0.0:1789120745.730256:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305600 00000100:00100000:0.0:1789120745.730335:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789120745.730347:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62440a6e-232c-434d-8868-70f19c1fd072+6:8123:x1876028901305600:12345-192.168.206.9@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789120745.730723:0:5860:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789120745.731284:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62440a6e-232c-434d-8868-70f19c1fd072+6:8123:x1876028901305600:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 936us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120745.731299:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789120745.735494:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120745.735661:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305344 00000100:00100000:2.0:1789120745.735674:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305344 00000100:00100000:2.0:1789120745.735743:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120745.735753:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5907840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1876028901305344:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789120745.735793:0:8216:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 62440a6e-232c-434d-8868-70f19c1fd072@192.168.206.9@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1789120745.735830:0:8216:0:(genops.c:1385:class_connect()) connect: client 62440a6e-232c-434d-8868-70f19c1fd072, cookie 0x13cfa3d77faa4dfc 00002000:00100000:2.0:1789120745.735846:0:8216:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62440a6e-232c-434d-8868-70f19c1fd072/ffff9ffdb590e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789120745.735880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120745.735979:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305472 00000100:00100000:1.0:1789120745.735984:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305472 00002000:00100000:2.0:1789120745.736061:0:8216:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789120745.736129:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789120745.736136:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901305472:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789120745.736257:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 62440a6e-232c-434d-8868-70f19c1fd072@192.168.206.9@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1789120745.736287:0:6707:0:(genops.c:1385:class_connect()) connect: client 62440a6e-232c-434d-8868-70f19c1fd072, cookie 0x13cfa3d77faa4e03 00002000:00100000:1.0:1789120745.736295:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62440a6e-232c-434d-8868-70f19c1fd072/ffff9ffd9d39d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120745.736303:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789120745.736430:0:8216:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1789120745.736529:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789120745.736567:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d39b800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789120745.736619:0:8216:0:(import.c:65:import_set_state_nolock()) ffff9ffdb590c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120745.736712:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+6:2348:x1876028901305472:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 573us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120745.736722:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120745.738639:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5907840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:2348:x1876028901305344:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 2871us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120745.738655:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00010000:00010000:3.0:1789120746.734993:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120747.754347:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789120748.327765:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00010000:00010000:2.0:1789120748.787303:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120748.796333:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922308992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120748.796419:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120748.799239:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922308992 00000100:00100000:0.0:1789120748.799265:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922308992 00000100:00100000:0.0:1789120748.799338:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120748.799350:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922308992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120748.799384:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120748.799459:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922308992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120748.799467:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789120748.799723:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789120748.799759:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1b6b0c0 x1876028922308992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120748.799781:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922308992:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789120748.834102:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00000001:00100000:1.0:1789120748.850274:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00010000:00010000:1.0:1789120749.803261:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120750.314835:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120750.314860:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922309120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120750.314927:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120750.315238:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922309504:0@lo:400:kworker.0 00000100:00100000:0.0:1789120750.315283:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120750.315314:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120750.315320:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922309632:0@lo:400:kworker.0 00000100:00100000:0.0:1789120750.315345:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120750.315377:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309632 00000100:00100000:0.0:1789120750.315383:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309632 00000100:00100000:0.0:1789120750.315435:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789120750.315443:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922309632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120750.315492:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922309632:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120750.315499:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789120750.315525:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789120750.315559:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee52c0 x1876028922309632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120750.315574:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922309632:0@lo:400:kworker.0 00000100:00100000:2.0:1789120750.315747:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309120 00000100:00100000:2.0:1789120750.315756:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309120 00000100:00100000:2.0:1789120750.315809:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789120750.315816:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922309120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120750.315844:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120750.315885:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922309120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120750.315892:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789120750.315938:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb9506d00 x1876028922309120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120750.316087:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9506d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922309120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120750.316351:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922309248:0@lo:400:kworker.0 00000100:00100000:3.0:1789120750.316390:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120750.316420:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922309760:0@lo:400:kworker.0 00000100:00100000:3.0:1789120750.316444:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120750.316463:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120750.316469:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922309376:0@lo:400:kworker.0 00000100:00100000:3.0:1789120750.316490:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120750.316516:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309504 00000100:00100000:3.0:1789120750.316520:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309504 00000100:00100000:3.0:1789120750.316549:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309760 00000100:00100000:3.0:1789120750.316551:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309760 00000100:00100000:3.0:1789120750.316576:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309376 00000100:00100000:3.0:1789120750.316578:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309376 00000100:00100000:3.0:1789120750.316591:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120750.316597:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922309504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120750.316722:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789120750.316731:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922309760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120750.316781:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922309760:12345-0@lo:400:kworker.0 Request processed in 52us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120750.316793:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789120750.316818:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789120750.316824:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922309376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120750.316851:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922309376:12345-0@lo:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120750.316856:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789120750.316885:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922309376:0@lo:400:kworker.0 00000100:00100000:1.0:1789120750.316893:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922309760:0@lo:400:kworker.0 00000100:00100000:3.0:1789120750.317266:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922309504:12345-0@lo:400:kworker.0 Request processed in 667us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120750.317272:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789120750.317719:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309248 00000100:00100000:0.0:1789120750.317725:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309248 00000100:00100000:0.0:1789120750.317774:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789120750.317783:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922309248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120750.317843:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922309248:12345-0@lo:400:kworker.0 Request processed in 62us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120750.317850:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1789120750.317881:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120750.317886:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120750.318239:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922309248:0@lo:400:kworker.0 00000100:00100000:1.0:1789120750.318637:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922309504:0@lo:400:kworker.0 00010000:00010000:2.0:1789120750.826431:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120751.005430:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789120751.034137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120751.034198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120751.034226:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120751.034260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120751.034281:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120751.034315:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306240 00000100:00100000:2.0:1789120751.034323:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306240 00000100:00100000:1.0:1789120751.034348:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305728 00000100:00100000:1.0:1789120751.034352:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305728 00000100:00100000:2.0:1789120751.034372:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306112 00000100:00100000:2.0:1789120751.034375:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306112 00000100:00100000:1.0:1789120751.034377:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:1.0:1789120751.034385:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901305728:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120751.034394:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789120751.034399:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901306240:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120751.034464:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901305728:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120751.034471:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:3.0:1789120751.034554:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305984 00000100:00100000:3.0:1789120751.034559:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305984 00000100:00100000:3.0:1789120751.034586:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901305856 00000100:00100000:3.0:1789120751.034589:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901305856 00000100:00100000:3.0:1789120751.034609:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789120751.034616:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901305984:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120751.036458:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901306240:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 2048us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120751.036471:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789120751.036503:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789120751.036514:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901306112:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120751.036556:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901306112:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 46us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120751.036561:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789120751.036583:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:2.0:1789120751.036590:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9507c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901305856:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120751.036618:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9507c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901305856:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 29us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120751.036624:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00080000:2.0:1789120751.036646:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120751.036651:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120751.036653:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120751.047370:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901305984:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 12741us (13159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120751.047386:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00010000:00010000:3.0:1789120751.851921:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120752.874346:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120753.901119:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120753.905452:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922309888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120753.905519:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120753.905599:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922309888 00000100:00100000:1.0:1789120753.905606:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922309888 00000100:00100000:1.0:1789120753.905801:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789120753.905812:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922309888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120753.905856:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120753.905915:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922309888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120753.905923:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789120753.905952:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789120753.905983:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91f66580 x1876028922309888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120753.906003:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91f66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922309888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789120754.922572:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120755.435516:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922310144:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.435597:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.435680:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922310656:0@lo:400:kworker.0 00000100:00100000:1.0:1789120755.435688:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922310016:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.435711:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120755.435735:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120755.435777:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922310528:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.435778:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310656 00000100:00100000:3.0:1789120755.435788:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310656 00000100:00100000:1.0:1789120755.435808:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120755.435841:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922310272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.435865:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789120755.435871:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.435884:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120755.435896:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120755.435904:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310400:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.435946:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922310656:12345-0@lo:400:kworker.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120755.435957:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.435969:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120755.435990:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310400 00000100:00100000:3.0:1789120755.435994:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310400 00000100:00100000:3.0:1789120755.436022:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120755.436028:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.436066:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310400:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.436073:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789120755.436086:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310016 00000100:00100000:1.0:1789120755.436091:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310016 00010000:00080000:3.0:1789120755.436119:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee6d00 x1876028922310656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120755.436127:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789120755.436139:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922310016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.436165:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922310656:0@lo:400:kworker.0 00000100:00100000:0.0:1789120755.436260:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310144 00000100:00100000:0.0:1789120755.436265:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310144 00000100:00100000:0.0:1789120755.436305:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310528 00000100:00100000:0.0:1789120755.436313:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310528 00000100:00100000:0.0:1789120755.436328:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310272 00000100:00100000:0.0:1789120755.436330:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310272 00000100:00100000:0.0:1789120755.436341:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120755.436347:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922310144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120755.436382:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922310144:12345-0@lo:400:kworker.0 Request processed in 35us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.436388:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120755.436400:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789120755.436406:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922310528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120755.436429:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922310528:12345-0@lo:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.436434:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789120755.436456:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120755.436462:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922310272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120755.436488:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922310272:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.436493:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789120755.436693:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922310016:12345-0@lo:400:kworker.0 Request processed in 73us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120755.436700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1789120755.436732:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120755.436737:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120755.436739:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120755.436774:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922310016:0@lo:400:kworker.0 00000100:00100000:1.0:1789120755.436785:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922310528:0@lo:400:kworker.0 00010000:00080000:1.0:1789120755.436809:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee4f00 x1876028922310400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120755.436817:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310400:0@lo:400:kworker.0 00000100:00100000:1.0:1789120755.436824:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922310272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.436985:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922310144:0@lo:400:kworker.0 00000100:00100000:3.0:1789120755.440445:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120755.440589:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.448631:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310784 00000100:00100000:0.0:1789120755.448646:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310784 00000100:00100000:0.0:1789120755.448721:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789120755.448732:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d075e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120755.448771:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120755.448846:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d075e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.448853:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789120755.448979:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee6940 x1876028922310784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120755.449011:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789120755.958190:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120756.146420:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120756.146519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120756.146588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120756.146619:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120756.146776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306368 00000100:00100000:1.0:1789120756.146785:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306368 00000100:00100000:1.0:1789120756.146846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:1.0:1789120756.146856:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901306368:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120756.146920:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901306368:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 66us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120756.146928:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:3.0:1789120756.147123:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306880 00000100:00100000:3.0:1789120756.147128:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306880 00000100:00100000:3.0:1789120756.147196:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:3.0:1789120756.147206:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9506940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306880:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120756.147243:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9506940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306880:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120756.147276:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00080000:1.0:1789120756.147641:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120756.148322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120756.151833:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306752 00000100:00100000:3.0:1789120756.151848:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306752 00000100:00100000:3.0:1789120756.151931:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789120756.151943:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306752:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120756.152014:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306752:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 74us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120756.152022:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00080000:2.0:1789120756.153351:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120756.155249:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306624 00000100:00100000:0.0:1789120756.155287:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306624 00000100:00100000:0.0:1789120756.155358:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901306496 00000100:00100000:0.0:1789120756.155362:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901306496 00000100:00100000:0.0:1789120756.155394:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:0.0:1789120756.155403:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306624:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120756.155477:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901306624:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 75us (8958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120756.155484:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:0.0:1789120756.155501:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:0.0:1789120756.155507:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9506d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901306496:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120756.155530:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9506d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901306496:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 24us (8911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120756.155536:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00080000:2.0:1789120756.157769:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120756.970385:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120757.998576:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120759.018478:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120759.020966:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120759.020988:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120759.021049:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120759.021890:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922310912 00000100:00100000:3.0:1789120759.021899:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922310912 00000100:00100000:3.0:1789120759.021959:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120759.021969:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120759.022004:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120759.022063:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922310912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120759.022071:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789120759.022459:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789120759.023068:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5fc70c0 x1876028922310912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120759.023088:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922310912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789120760.042376:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120760.555046:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922311168:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555183:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555232:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922311680:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555270:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555304:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120760.555310:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922311040:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555337:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555356:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922311552:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555377:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555403:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922311424:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555894:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555918:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120760.555925:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922311296:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.555948:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.555978:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311168 00000100:00100000:0.0:1789120760.555984:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311168 00000100:00100000:0.0:1789120760.556033:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311552 00000100:00100000:0.0:1789120760.556037:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311552 00000100:00100000:0.0:1789120760.556059:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311296 00000100:00100000:0.0:1789120760.556062:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311296 00000100:00100000:0.0:1789120760.556076:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120760.556083:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922311168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.556133:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922311168:12345-0@lo:400:kworker.0 Request processed in 49us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.556139:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120760.556516:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120760.556525:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922311552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.556560:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922311552:12345-0@lo:400:kworker.0 Request processed in 37us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.556566:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120760.556578:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120760.556584:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922311296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.556616:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922311296:12345-0@lo:400:kworker.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.556623:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120760.556641:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311680 00000100:00100000:0.0:1789120760.556644:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311680 00000100:00100000:0.0:1789120760.556680:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311424 00000100:00100000:0.0:1789120760.556684:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311424 00000100:00100000:0.0:1789120760.556702:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789120760.556708:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922311680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.556741:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922311680:12345-0@lo:400:kworker.0 Request processed in 33us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.556747:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789120760.556757:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120760.556763:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922311424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.556952:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1afd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922311424:12345-0@lo:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.556961:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789120760.557352:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120760.557357:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120760.557389:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922311552:0@lo:400:kworker.0 00000100:00100000:0.0:1789120760.557403:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922311168:0@lo:400:kworker.0 00000100:00100000:1.0:1789120760.557948:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311040 00000100:00100000:1.0:1789120760.557954:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311040 00000100:00100000:1.0:1789120760.557991:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789120760.557999:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922311040:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789120760.558084:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee5680 x1876028922311680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120760.558097:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922311680:0@lo:400:kworker.0 00000100:00100000:3.0:1789120760.559805:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922311296:0@lo:400:kworker.0 00010000:00080000:3.0:1789120760.559824:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee4f00 x1876028922311424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120760.559834:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922311424:0@lo:400:kworker.0 00000100:00100000:3.0:1789120760.559855:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120760.559864:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922311808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120760.559915:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120760.559959:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311808 00000100:00100000:3.0:1789120760.559971:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311808 00000100:00100000:3.0:1789120760.560008:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120760.560016:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922311808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120760.560050:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120760.560088:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922311808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120760.560095:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789120760.560124:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5ddb840 x1876028922311808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120760.560140:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922311808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120760.565793:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922311040:12345-0@lo:400:kworker.0 Request processed in 7786us (10446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120760.565807:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789120760.570922:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922311040:0@lo:400:kworker.0 00010000:00010000:2.0:1789120761.066422:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120761.264511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120761.264558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120761.264590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120761.264613:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307264 00000100:00100000:1.0:1789120761.264621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120761.264623:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307264 00000100:00100000:1.0:1789120761.264645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120761.264672:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307136 00000100:00100000:0.0:1789120761.264675:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307136 00000100:00100000:1.0:1789120761.264689:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:0.0:1789120761.264695:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:1.0:1789120761.264699:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307264:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120761.264701:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901307136:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120761.264776:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307520 00000100:00100000:3.0:1789120761.264780:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307520 00000100:00100000:3.0:1789120761.264809:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307392 00000100:00100000:3.0:1789120761.264812:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307392 00000100:00100000:3.0:1789120761.264831:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:3.0:1789120761.264838:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307520:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120761.264896:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307008 00000100:00100000:2.0:1789120761.264900:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307008 00000100:00100000:2.0:1789120761.264928:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:2.0:1789120761.264936:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901307008:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120761.265105:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901307136:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 403us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120761.265114:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00080000:0.0:1789120761.265140:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120761.265168:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120761.265171:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120761.265183:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:1.0:1789120761.265190:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307264:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 481us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120761.265190:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307392:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120761.265197:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:0.0:1789120761.265215:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307392:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120761.265222:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789120761.265355:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901307520:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 516us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120761.265363:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789120761.265479:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901307008:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 544us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120761.265486:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 224 00010000:00010000:3.0:1789120762.090913:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120763.114378:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120764.138399:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120764.138421:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922311936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120764.138487:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120764.138550:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922311936 00000100:00100000:0.0:1789120764.138558:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922311936 00000100:00100000:0.0:1789120764.138619:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120764.138627:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922311936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120764.138656:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120764.138698:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922311936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120764.138704:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789120764.138744:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee4000 x1876028922311936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120764.138762:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922311936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789120764.139605:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120764.141124:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789120765.162531:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120765.674369:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922312320:0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.674436:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120765.674500:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120765.674507:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922312448:0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.674532:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120765.674573:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312320 00000100:00100000:0.0:1789120765.674591:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312320 00000100:00100000:0.0:1789120765.674642:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120765.674652:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922312320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.674701:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922312320:12345-0@lo:400:kworker.0 Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120765.674709:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120765.674730:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312448 00000100:00100000:0.0:1789120765.674733:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312448 00000100:00100000:0.0:1789120765.674758:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789120765.674780:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.674811:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922312448:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120765.674818:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789120765.674851:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee61c0 x1876028922312448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120765.674864:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922312448:0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.674875:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922312320:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.675826:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922312064:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.675872:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.675918:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922312576:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.675940:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.675962:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789120765.675968:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922312192:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.675986:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.676001:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922312704:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.676035:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120765.676060:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120765.676073:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312576 00000100:00100000:1.0:1789120765.676085:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312576 00000100:00100000:1.0:1789120765.676125:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312192 00000100:00100000:1.0:1789120765.676128:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312192 00000100:00100000:1.0:1789120765.676172:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789120765.676179:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922312576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.676234:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922312576:12345-0@lo:400:kworker.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120765.676242:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789120765.676258:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789120765.676265:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.676290:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922312192:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120765.676296:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789120765.676315:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120765.676337:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922312192:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.676347:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922312576:0@lo:400:kworker.0 00000100:00100000:3.0:1789120765.676447:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312704 00000100:00100000:3.0:1789120765.676451:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312704 00000100:00100000:3.0:1789120765.676496:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120765.676502:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922312704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120765.676541:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922312704:12345-0@lo:400:kworker.0 Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120765.676557:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120765.676566:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312064 00000100:00100000:0.0:1789120765.676570:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312064 00000100:00080000:3.0:1789120765.676578:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120765.676595:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee5680 x1876028922312704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120765.676605:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922312704:0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.676619:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789120765.676625:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922312064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120765.676669:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922312064:12345-0@lo:400:kworker.0 Request processed in 44us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120765.676675:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789120765.676723:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922312064:0@lo:400:kworker.0 00000100:00100000:1.0:1789120765.677697:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120765.677711:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922312832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120765.677750:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.677866:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312832 00000100:00100000:1.0:1789120765.677872:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312832 00000100:00100000:1.0:1789120765.677905:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789120765.677913:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922312832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120765.677941:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120765.677976:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922312832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120765.677993:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789120765.678025:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5fc4780 x1876028922312832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120765.678041:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922312832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789120766.186486:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120766.380440:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789120766.386379:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120766.386414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120766.386442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120766.386479:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120766.386503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120766.386531:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307904 00000100:00100000:2.0:1789120766.386541:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307904 00000100:00100000:2.0:1789120766.386607:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307776 00000100:00100000:2.0:1789120766.386611:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307776 00000100:00100000:2.0:1789120766.386648:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789120766.386657:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901307904:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120766.386714:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901307648 00000100:00100000:1.0:1789120766.386720:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901307648 00000100:00100000:2.0:1789120766.386731:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901307904:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120766.386740:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:1.0:1789120766.386751:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:1.0:1789120766.386761:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901307648:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120766.386764:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789120766.386776:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901307776:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120766.386795:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901307648:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120766.386802:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:2.0:1789120766.386810:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901307776:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 35us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120766.386817:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:2.0:1789120766.386842:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308032 00000100:00100000:2.0:1789120766.386845:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308032 00000100:00100000:2.0:1789120766.386882:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308160 00000100:00100000:2.0:1789120766.386886:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308160 00000100:00100000:0.0:1789120766.386890:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:0.0:1789120766.386902:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2348:x1876028901308032:12345-192.168.206.9@tcp:9:kworker.0 00000100:00100000:2.0:1789120766.386916:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789120766.386926:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2348:x1876028901308160:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:0.0:1789120766.386933:0:8216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4dfc 00000020:00000080:2.0:1789120766.386943:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4e03 00000100:00080000:0.0:1789120766.386943:0:8216:0:(import.c:65:import_set_state_nolock()) ffff9ffdb590c000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789120766.386953:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d39b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789120766.386989:0:8216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1789120766.386992:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789120766.387401:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62440a6e-232c-434d-8868-70f19c1fd072+2:2348:x1876028901308160:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 475us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120766.387415:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00080000:2.0:1789120766.387436:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120766.387441:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120766.387445:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120766.387499:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62440a6e-232c-434d-8868-70f19c1fd072+2:2348:x1876028901308032:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 598us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120766.387507:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00010000:00010000:2.0:1789120766.387599:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120766.387605:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120767.211433:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120768.237376:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120769.260432:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922312960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120769.260495:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120769.260572:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922312960 00000100:00100000:0.0:1789120769.260579:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922312960 00000100:00100000:0.0:1789120769.260631:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120769.260641:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922312960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120769.260672:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120769.260713:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922312960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.260720:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789120769.260740:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789120769.261221:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafee5a40 x1876028922312960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120769.261255:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922312960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789120769.262862:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789120769.312771:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00000020:00000080:2.0:1789120769.312781:0:6729:0:(genops.c:885:class_export_put()) final put ffff9ffdb590e800/62440a6e-232c-434d-8868-70f19c1fd072 00000020:00000080:2.0:1789120769.313276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb590e800/62440a6e-232c-434d-8868-70f19c1fd072 for lustre-OST0000 00000020:00000080:2.0:1789120769.313322:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb590c000 for lustre-OST0000 00000001:00100000:0.0:1789120769.331621:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00000020:00000080:0.0:1789120769.331630:0:7651:0:(genops.c:885:class_export_put()) final put ffff9ffd9d39d000/62440a6e-232c-434d-8868-70f19c1fd072 00000020:00000080:2.0:1789120769.331695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd9d39d000/62440a6e-232c-434d-8868-70f19c1fd072 for lustre-OST0001 00000020:00000080:2.0:1789120769.331846:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd9d39b800 for lustre-OST0001 00000020:00000080:3.0:1789120769.419567:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe739b8a0 20000000:00000080:3.0:1789120769.419585:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdc1d0bc00 uarg=0000000000000000 20000000:01000000:3.0:1789120769.419620:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120769.419626:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120769.419631:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789120769.421435:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789120769.421618:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789120769.426959:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789120769.427068:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427086:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427094:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427101:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427111:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427123:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.427131:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429306:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429339:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 12 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.429355:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313088:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120769.429510:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429520:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 12 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.429528:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5485a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313216:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120769.429561:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429570:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 18 pid: 5852 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.429579:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313344:0@lo:104: 00000100:00100000:2.0:1789120769.429613:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120769.429668:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429676:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 18 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.429684:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313472:0@lo:104: 00000100:00100000:2.0:1789120769.429703:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120769.429733:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.429741:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 18 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.429759:0:11173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313600:0@lo:104: 00000100:00100000:2.0:1789120769.429778:0:11173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.429786:0:11173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120769.429862:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313344 00000100:00100000:0.0:1789120769.429869:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313344 00000100:00100000:0.0:1789120769.429906:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313472 00000100:00100000:0.0:1789120769.429909:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313472 00000100:00100000:0.0:1789120769.429917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313600 00000100:00100000:0.0:1789120769.429919:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313600 00000100:00100000:0.0:1789120769.429929:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120769.429936:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:11173:x1876028922313344:12345-0@lo:104: 00010000:00010000:0.0:1789120769.429948:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.430005:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120769.430011:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:11173:x1876028922313344:12345-0@lo:104: Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.430018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120769.430034:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120769.430040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:11173:x1876028922313472:12345-0@lo:104: 00010000:00010000:0.0:1789120769.430048:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.430079:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120769.430084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:11173:x1876028922313472:12345-0@lo:104: Request processed in 45us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.430090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120769.430108:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789120769.430113:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11173:x1876028922313600:12345-0@lo:104: 00010000:00010000:0.0:1789120769.430121:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.430176:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789120769.430181:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11173:x1876028922313600:12345-0@lo:104: Request processed in 68us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.430187:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789120769.430257:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789120769.430263:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430270:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690400 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120769.430275:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430283:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120769.430290:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120769.430296:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120769.430331:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430337:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120769.430356:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430372:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81690400/0x13cfa3d77faa4dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dd2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430386:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120769.430389:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430394:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120769.430397:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430403:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120769.430408:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120769.430412:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120769.430425:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430430:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120769.430436:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430441:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4dc4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430450:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120769.430458:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430463:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120769.430466:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430472:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120769.430477:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120769.430481:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120769.430492:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430497:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120769.430510:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430515:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b400/0x13cfa3d77faa4daf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4db6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430526:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120769.430528:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120769.430529:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120769.430535:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120769.430545:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922313728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120769.430574:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.430604:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120769.430615:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922313856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120769.430636:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.430664:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922313984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120769.430684:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.430714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313728 00000100:00100000:2.0:1789120769.430718:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313728 00010000:00010000:2.0:1789120769.430739:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 19 pid: 5852 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.430753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313856 00000100:00100000:2.0:1789120769.430755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313856 00010000:00010000:2.0:1789120769.430765:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 20 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.430773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922313984 00000100:00100000:2.0:1789120769.430775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922313984 00010000:00010000:2.0:1789120769.430783:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 21 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.430794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120769.430800:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+21:3317:x1876028922313728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120769.430811:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120769.430815:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 21 pid: 5852 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430824:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 21 pid: 5852 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430838:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120769.430866:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+21:3317:x1876028922313728:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.430879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120769.430917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789120769.430924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:3317:x1876028922313856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120769.430931:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120769.430935:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 20 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430943:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 20 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.430953:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120769.430975:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:3317:x1876028922313856:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.430980:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789120769.430991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120769.430997:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922313984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120769.431004:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120769.431008:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 19 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.431015:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 19 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.431023:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120769.431049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922313984:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.431054:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120769.431087:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922313984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120769.431119:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922313856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120769.431126:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922313728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120769.431188:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4a200/0x13cfa3d77faa4dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4dcb expref: 18 pid: 5852 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.431210:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313344:0@lo:104: 00010000:00010000:2.0:1789120769.431221:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690e00/0x13cfa3d77faa4dc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4dbd expref: 17 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.431230:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313472:0@lo:104: 00010000:00010000:2.0:1789120769.431238:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691c00/0x13cfa3d77faa4db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4daf expref: 16 pid: 5850 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.431245:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313600:0@lo:104: 00000100:00100000:2.0:1789120769.435783:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120769.435821:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120769.435935:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308288 00000100:00100000:3.0:1789120769.435943:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308288 00010000:00010000:3.0:1789120769.435979:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 13 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120769.436014:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308416 00000100:00100000:3.0:1789120769.436017:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308416 00010000:00010000:3.0:1789120769.436029:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 14 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120769.436044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789120769.436052:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+14:2349:x1876028901308288:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120769.436077:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120769.436083:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 14 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436095:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 14 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436114:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120769.436186:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+14:2349:x1876028901308288:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 135us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.436204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789120769.436221:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:3.0:1789120769.436229:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901308416:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120769.436236:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120769.436240:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 13 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436248:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 13 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436259:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436268:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436282:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436299:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436321:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436329:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436335:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120769.436339:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436347:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436356:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.436366:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120769.436388:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901308416:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 160us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.436395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00010000:00010000:0.0:1789120769.438004:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa4dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acda expref: 12 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120769.438023:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313088:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120769.438035:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa4dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca2 expref: 11 pid: 5851 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120769.438043:0:11173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5485a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1876028922313216:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120769.438070:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.438079:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.438086:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.438092:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4e0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.282425:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120770.795345:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922314112:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795411:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795469:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922314624:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795497:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795523:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120770.795530:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922314496:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795568:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795594:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922314240:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795646:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922314752:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795666:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795682:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120770.795688:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922314368:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795707:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.795751:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314624 00000100:00100000:2.0:1789120770.795759:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314624 00000100:00100000:2.0:1789120770.795818:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314240 00000100:00100000:2.0:1789120770.795822:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314240 00000100:00100000:2.0:1789120770.795834:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314368 00000100:00100000:2.0:1789120770.795836:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314368 00000100:00100000:2.0:1789120770.795851:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120770.795858:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922314624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795906:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922314624:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.795912:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120770.795928:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789120770.795933:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922314240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.795975:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922314240:12345-0@lo:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.795981:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789120770.795992:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120770.795998:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922314368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.796023:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922314368:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.796029:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120770.796056:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314496 00000100:00100000:2.0:1789120770.796059:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314496 00000100:00100000:2.0:1789120770.796080:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314752 00000100:00100000:2.0:1789120770.796083:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314752 00000100:00100000:2.0:1789120770.796104:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789120770.796110:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922314496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.796139:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922314496:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.796174:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789120770.796196:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789120770.796202:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922314752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.796229:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922314752:12345-0@lo:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.796234:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789120770.796258:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120770.796262:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120770.796296:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922314368:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.796306:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922314240:0@lo:400:kworker.0 00010000:00080000:2.0:1789120770.796318:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5fc4b40 x1876028922314752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120770.796327:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922314752:0@lo:400:kworker.0 00010000:00080000:2.0:1789120770.796356:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5fc61c0 x1876028922314496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120770.796365:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922314496:0@lo:400:kworker.0 00000100:00100000:2.0:1789120770.796375:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922314624:0@lo:400:kworker.0 00000100:00100000:1.0:1789120770.797344:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314112 00000100:00100000:1.0:1789120770.797352:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314112 00000100:00100000:1.0:1789120770.797392:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789120770.797399:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3320:x1876028922314112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120770.797449:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3320:x1876028922314112:12345-0@lo:400:kworker.0 Request processed in 51us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.797456:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789120770.797526:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922314112:0@lo:400:kworker.0 00000100:00100000:0.0:1789120770.798312:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120770.798325:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922314880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120770.798365:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120770.798449:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922314880 00000100:00100000:1.0:1789120770.798455:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922314880 00000100:00100000:1.0:1789120770.798492:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120770.798501:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922314880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120770.798529:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120770.798585:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922314880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.798603:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789120770.798761:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5dd8000 x1876028922314880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120770.798777:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922314880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120770.799791:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120770.799861:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308544 00000100:00100000:0.0:1789120770.799868:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308544 00000100:00100000:0.0:1789120770.799906:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:0.0:1789120770.799915:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:5591:x1876028901308544:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120770.799927:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120770.799944:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad04 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120770.799980:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120770.799991:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120770.800000:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a600, rc 0) 00000100:00100000:0.0:1789120770.800049:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308544:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 135us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120770.800055:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:2.0:1789120770.804526:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120770.804674:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308672 00000100:00100000:1.0:1789120770.804684:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308672 00000100:00100000:1.0:1789120770.804738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:1.0:1789120770.804748:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308672:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120770.805023:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308672:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 276us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.805031:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:2.0:1789120770.810010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120770.810092:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308800 00000100:00100000:1.0:1789120770.810100:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308800 00000100:00100000:1.0:1789120770.810195:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:1.0:1789120770.810204:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308800:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120770.810420:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308800:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 217us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.810428:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:3.0:1789120770.825380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120770.825479:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901308928 00000100:00100000:2.0:1789120770.825489:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901308928 00000100:00100000:2.0:1789120770.825552:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:2.0:1789120770.825562:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901308928:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120770.825580:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120770.825598:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad0b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.825641:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.825652:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.825661:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5200, rc 0) 00000100:00100000:2.0:1789120770.825723:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901308928:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.825730:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:3.0:1789120770.828393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120770.828996:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309056 00000100:00100000:2.0:1789120770.829005:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309056 00000100:00100000:2.0:1789120770.829104:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:2.0:1789120770.829114:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901309056:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120770.829447:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901309056:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 334us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.829455:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:3.0:1789120770.844070:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120770.844178:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309184 00000100:00100000:1.0:1789120770.844197:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309184 00000100:00100000:1.0:1789120770.844241:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 233 00000100:00100000:1.0:1789120770.844250:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901309184:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120770.844473:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901309184:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 219us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.844481:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 233 10000000:01000000:2.0:1789120770.990848:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120770.990857:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdbfb5a800 from 7 10000000:01000000:2.0:1789120770.990863:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120770.990905:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.990917:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.990930:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120770.991126:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120770.991225:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.991282:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120770.992035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315008 00000100:00100000:3.0:1789120770.992043:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315008 00000100:00100000:3.0:1789120770.992090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789120770.992100:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922315008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120770.992115:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120770.992129:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e1f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120770.992175:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120770.992198:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120770.992208:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a600, rc 0) 00000100:00100000:3.0:1789120770.992265:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120770.992271:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789120770.992431:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120770.992609:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120770.992620:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120770.992677:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120770.992708:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120770.992746:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120770.992880:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315136 00000100:00100000:1.0:1789120770.992885:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315136 00000100:00100000:1.0:1789120770.992929:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789120770.992936:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120770.993207:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.993214:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789120770.993307:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120770.993339:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120770.993378:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120770.993411:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120770.993520:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315264 00000100:00100000:1.0:1789120770.993524:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315264 00000100:00100000:1.0:1789120770.993555:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789120770.993562:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120770.993717:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.993727:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789120770.993850:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789120771.001318:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789120771.001586:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789120771.001608:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120771.001630:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120771.001657:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120771.001666:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120771.001669:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaf537000 from 7 10000000:01000000:2.0:1789120771.001671:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120771.001706:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120771.001714:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120771.001724:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120771.001748:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120771.001809:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120771.001853:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120771.001867:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315392 00000100:00100000:1.0:1789120771.001874:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315392 00000100:00100000:1.0:1789120771.001921:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789120771.001930:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922315392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120771.001944:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120771.001956:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e2d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.001977:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.001987:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.001995:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb000, rc 0) 00000100:00100000:1.0:1789120771.002031:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.002043:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789120771.002049:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120771.002062:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120771.002070:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120771.002113:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120771.002138:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120771.002201:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120771.002414:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315520 00000100:00100000:1.0:1789120771.002418:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315520 00000100:00100000:1.0:1789120771.002439:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789120771.002444:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120771.002896:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.002904:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789120771.003725:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120771.003767:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120771.003815:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120771.003852:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90f4fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120771.003888:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315648 00000100:00100000:1.0:1789120771.003895:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315648 00000100:00100000:1.0:1789120771.003935:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789120771.003943:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120771.004115:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.004122:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789120771.004230:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ce1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789120771.005264:0:11214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789120771.005521:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789120771.005539:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120771.005558:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120771.005569:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120771.005580:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120771.005583:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 7 10000000:01000000:3.0:1789120771.005585:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120771.005617:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120771.005625:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120771.005635:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120771.005653:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120771.005703:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120771.005743:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120771.006261:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315776 00000100:00100000:1.0:1789120771.006268:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315776 00000100:00100000:1.0:1789120771.006307:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789120771.006318:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922315776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120771.006330:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120771.006342:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e3b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.006380:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.006391:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.006408:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120771.006456:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922315776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.006463:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789120771.006533:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120771.006549:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120771.006558:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120771.006606:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120771.006644:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120771.006679:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120771.008771:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922315904 00000100:00100000:1.0:1789120771.008782:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922315904 00000100:00100000:1.0:1789120771.008833:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789120771.008842:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922315904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120771.009120:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922315904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.009128:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789120771.009199:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120771.009246:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922316032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120771.009290:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120771.009329:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120771.009343:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316032 00000100:00100000:0.0:1789120771.009346:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316032 00000100:00100000:0.0:1789120771.009369:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789120771.009375:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922316032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120771.009502:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922316032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120771.009509:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789120771.009543:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922316032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789120771.011119:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789120771.011291:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789120771.011308:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120771.011318:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120771.011328:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120771.306872:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120771.514122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120771.514197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120771.514224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120771.514250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309312 00000100:00100000:0.0:1789120771.514259:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309312 00000100:00100000:0.0:1789120771.514306:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 243 00000100:00100000:0.0:1789120771.514316:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901309312:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120771.514872:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309568 00000100:00100000:1.0:1789120771.514877:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309568 00000100:00100000:1.0:1789120771.514916:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309440 00000100:00100000:1.0:1789120771.514920:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309440 00000100:00100000:1.0:1789120771.514942:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:1.0:1789120771.514948:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901309568:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120771.516573:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:2.0:1789120771.516593:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901309440:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120771.517844:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901309312:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 3513us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120771.517866:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 243 00000100:00100000:1.0:1789120771.522802:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901309568:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 7841us (8593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120771.522833:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00080000:1.0:1789120771.522953:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120771.527963:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901309440:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 11369us (13728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120771.527978:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00010000:00010000:0.0:1789120772.332098:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789120773.312847:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789120773.364793:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120774.380269:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120774.380537:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120774.380559:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922316160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120774.380626:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120774.380744:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316160 00000100:00100000:1.0:1789120774.380752:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316160 00000100:00100000:1.0:1789120774.380808:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120774.380817:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922316160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120774.380849:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120774.380894:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922316160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120774.380902:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789120774.381987:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789120774.382042:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb99cc000 x1876028922316160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120774.382062:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922316160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789120775.405891:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120775.918253:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120775.918274:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120775.918330:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922316416:0@lo:400:kworker.0 00000100:00100000:3.0:1789120775.918332:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918362:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918387:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316416 00000100:00100000:0.0:1789120775.918393:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316416 00000100:00100000:0.0:1789120775.918430:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789120775.918438:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922316416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918483:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922316416:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120775.918491:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789120775.918530:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922316672:0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918554:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922316416:0@lo:400:kworker.0 00000100:00100000:3.0:1789120775.918557:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918561:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5484f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922316928:0@lo:400:kworker.0 00000100:00100000:3.0:1789120775.918573:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120775.918581:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120775.918590:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5485a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922316800:0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918605:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789120775.918610:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922316544:0@lo:400:kworker.0 00000100:00100000:3.0:1789120775.918612:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918643:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922317056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918664:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120775.918689:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316672 00000100:00100000:0.0:1789120775.918692:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316672 00000100:00100000:0.0:1789120775.918729:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316928 00000100:00100000:0.0:1789120775.918732:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316928 00000100:00100000:0.0:1789120775.918745:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316544 00000100:00100000:0.0:1789120775.918747:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316544 00000100:00100000:0.0:1789120775.918768:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789120775.918774:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922316672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918809:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922316672:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120775.918815:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789120775.918827:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789120775.918833:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918863:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91f64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922316928:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120775.918869:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789120775.918879:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789120775.918884:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922316544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.918912:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922316544:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120775.918918:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1789120775.918939:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120775.918949:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316800 00000100:00100000:2.0:1789120775.918955:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316800 00000100:00100000:0.0:1789120775.918966:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922316672:0@lo:400:kworker.0 00000100:00100000:2.0:1789120775.918989:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317056 00000100:00100000:2.0:1789120775.918993:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317056 00000100:00100000:0.0:1789120775.918998:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922316544:0@lo:400:kworker.0 00000100:00100000:0.0:1789120775.919012:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5484f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922316928:0@lo:400:kworker.0 00000100:00100000:2.0:1789120775.919027:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789120775.919036:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922316800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120775.919186:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922316288 00000100:00100000:1.0:1789120775.919191:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922316288 00000100:00100000:1.0:1789120775.919216:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789120775.919223:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922316288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120775.919251:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120775.919369:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922316800:12345-0@lo:400:kworker.0 Request processed in 333us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120775.919377:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789120775.919395:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789120775.919402:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922317056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120775.919439:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922317056:12345-0@lo:400:kworker.0 Request processed in 37us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120775.919454:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789120775.919498:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789120775.919520:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5487480 x1876028922317056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120775.919531:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922317056:0@lo:400:kworker.0 00000100:00100000:1.0:1789120775.921123:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922316288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1891us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120775.921136:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789120775.921403:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5485a40 x1876028922316800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120775.921415:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5485a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922316800:0@lo:400:kworker.0 00010000:00080000:0.0:1789120775.921433:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5dd8f00 x1876028922316288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120775.921463:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922316288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789120776.426639:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120776.631669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120776.631780:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120776.631870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120776.631971:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309696 00000100:00100000:0.0:1789120776.631982:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309696 00000100:00100000:0.0:1789120776.632048:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 245 00000100:00100000:0.0:1789120776.632058:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901309696:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120776.632130:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901309696:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 74us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120776.632138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 245 00000100:00100000:1.0:1789120776.636127:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309952 00000100:00100000:1.0:1789120776.636173:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309952 00000100:00100000:0.0:1789120776.636316:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901309824 00000100:00100000:0.0:1789120776.636321:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901309824 00000100:00100000:0.0:1789120776.636348:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:0.0:1789120776.636357:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901309952:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120776.636426:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901309952:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120776.636433:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:0.0:1789120776.636449:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:0.0:1789120776.636456:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901309824:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120776.636481:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901309824:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 26us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120776.636486:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00080000:1.0:1789120776.636542:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120777.450388:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120778.475385:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120778.486637:0:11616:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeade78e10 20000000:00000080:3.0:1789120778.486655:0:11616:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdc1d0a800 uarg=0000000000000000 20000000:01000000:3.0:1789120778.486687:0:11616:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120778.486694:0:11616:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120778.486698:0:11616:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789120778.491323:0:11617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789120778.491480:0:11616:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789120778.498136:0:11616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789120778.498895:0:11616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789120778.498950:0:11616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789120778.498975:0:11616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789120778.498992:0:11616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499011:0:11616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499019:0:11616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499027:0:11616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499034:0:11616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499041:0:11616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499048:0:11616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499080:0:11616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499094:0:11616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 18 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120778.499106:0:11616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317184:0@lo:104: 00000100:00100000:0.0:1789120778.499567:0:11616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120778.499811:0:11616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499828:0:11616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120778.499838:0:11616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317312:0@lo:104: 00000100:00100000:0.0:1789120778.499862:0:11616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.499890:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317184 00000100:00100000:0.0:1789120778.499895:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317184 00000100:00100000:0.0:1789120778.499924:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317312 00000100:00100000:0.0:1789120778.499926:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317312 00000100:00100000:0.0:1789120778.499936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120778.499943:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:11616:x1876028922317184:12345-0@lo:104: 00010000:00010000:0.0:1789120778.499955:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.499991:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120778.499996:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:11616:x1876028922317184:12345-0@lo:104: Request processed in 54us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.500003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120778.500017:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120778.500022:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11616:x1876028922317312:12345-0@lo:104: 00010000:00010000:0.0:1789120778.500028:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500053:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120778.500058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11616:x1876028922317312:12345-0@lo:104: Request processed in 36us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.500063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789120778.500083:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120778.500089:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500096:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120778.500100:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500109:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120778.500115:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120778.500121:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789120778.500188:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500194:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120778.500212:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500219:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390b800/0x13cfa3d77faa4e3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e42 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500232:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120778.500235:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.500241:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4c00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120778.500244:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.500656:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120778.501274:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922317440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120778.501333:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120778.501417:0:11616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.501428:0:11616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 18 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120778.501438:0:11616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317568:0@lo:104: 00000100:00100000:1.0:1789120778.501465:0:11616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120778.501493:0:11616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.501503:0:11616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 12 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120778.501512:0:11616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317696:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120778.501563:0:11616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.501572:0:11616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120778.501580:0:11616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317824:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120778.501605:0:11616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120778.501636:0:11616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317184:0@lo:104: 00000100:00100000:1.0:1789120778.501647:0:11616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317312:0@lo:104: 00000100:00100000:3.0:1789120778.501859:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317440 00000100:00100000:3.0:1789120778.501866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317440 00010000:00010000:3.0:1789120778.501893:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.501926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120778.501934:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120778.501957:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120778.501963:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.501974:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.501989:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa4e42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e3b expref: 19 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.502002:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120778.502040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3319:x1876028922317440:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.502048:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120778.502077:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922317440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120778.502223:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120778.502237:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120778.502243:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789120778.502304:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502311:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120778.502325:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502333:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4e2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e34 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502344:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120778.502346:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120778.502348:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120778.502459:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922317952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120778.502488:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.502540:0:5840:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789120778.502550:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317568 00000100:00100000:0.0:1789120778.502554:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317568 00000100:00100000:0.0:1789120778.502582:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120778.502589:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5523c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11616:x1876028922317568:12345-0@lo:104: 00010000:00010000:0.0:1789120778.502598:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502653:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120778.502659:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5523c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:11616:x1876028922317568:12345-0@lo:104: Request processed in 71us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.502665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789120778.502709:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120778.502714:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502720:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120778.502723:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.502731:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120778.502738:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120778.502743:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789120778.502792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922317952 00000100:00100000:1.0:1789120778.502797:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922317952 00010000:00010000:1.0:1789120778.502823:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120778.502843:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120778.502849:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3320:x1876028922317952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120778.502857:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120778.502861:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.502869:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.502880:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bb000/0x13cfa3d77faa4e34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e2d expref: 18 pid: 5850 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.502888:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120778.502919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3320:x1876028922317952:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120778.502926:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120778.502957:0:11616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317568:0@lo:104: 00000100:00100000:1.0:1789120778.505300:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922317952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120778.505577:0:11616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317696:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120778.505844:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.505854:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120778.505886:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.505893:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4200/0x13cfa3d77faa4e1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e26 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.505927:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120778.505930:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120778.505932:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120778.505964:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120778.505975:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922318080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120778.506016:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.506096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318080 00000100:00100000:0.0:1789120778.506103:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318080 00010000:00010000:0.0:1789120778.506129:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120778.506185:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120778.506194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0246450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3318:x1876028922318080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120778.506205:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120778.506210:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.506221:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.506234:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390a600/0x13cfa3d77faa4e26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e1f expref: 17 pid: 5851 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.506245:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120778.506275:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0246450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3318:x1876028922318080:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.506282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120778.506324:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922318080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120778.508947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120778.509000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120778.509081:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310080 00000100:00100000:2.0:1789120778.509089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310080 00010000:00010000:2.0:1789120778.509123:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 13 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.509190:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310208 00000100:00100000:2.0:1789120778.509193:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310208 00010000:00010000:2.0:1789120778.509206:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 14 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.509221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789120778.509230:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+14:2350:x1876028901310080:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120778.509242:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120778.509247:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 14 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509271:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 14 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509288:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5200/0x13cfa3d77faa4e18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad0b expref: 14 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509302:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120778.509358:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901310080:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.509367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789120778.509382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:2.0:1789120778.509389:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:2350:x1876028901310208:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120778.509396:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120778.509401:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509410:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 12 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509422:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509430:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509444:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509451:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509458:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509465:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509471:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4be00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120778.509482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509489:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509497:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.509506:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120778.509526:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:2350:x1876028901310208:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 138us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.509533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00010000:00010000:1.0:1789120778.510378:0:11616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa4e11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad04 expref: 11 pid: 5852 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120778.510407:0:11616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11616:1876028922317824:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120778.510436:0:11616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.510446:0:11616:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.510451:0:11616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.510457:0:11616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4be00/0x13cfa3d77faa4e49 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120779.498786:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120779.502167:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120779.502187:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922318208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120779.502244:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120779.502754:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318208 00000100:00100000:1.0:1789120779.502762:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318208 00000100:00100000:1.0:1789120779.502822:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120779.502830:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922318208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120779.502862:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120779.503068:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922318208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.503076:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789120779.503114:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb99cde00 x1876028922318208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120779.503163:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922318208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789120779.503951:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120779.567675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120779.567826:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310336 00000100:00100000:2.0:1789120779.567836:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310336 00000100:00100000:2.0:1789120779.567882:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 246 00000100:00100000:2.0:1789120779.567892:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:5591:x1876028901310336:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120779.567909:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120779.567928:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad12 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.567955:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.567966:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.567991:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5e00, rc 0) 00000100:00100000:2.0:1789120779.568048:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310336:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 158us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.568056:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 246 00000100:00100000:2.0:1789120779.572858:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120779.573098:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310464 00000100:00100000:0.0:1789120779.573107:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310464 00000100:00100000:0.0:1789120779.573191:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 247 00000100:00100000:0.0:1789120779.573212:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310464:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120779.573490:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310464:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 278us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.573498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 247 00000100:00100000:3.0:1789120779.577289:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120779.578274:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310592 00000100:00100000:1.0:1789120779.578289:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310592 00000100:00100000:1.0:1789120779.578336:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 248 00000100:00100000:1.0:1789120779.578346:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310592:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120779.579020:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310592:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 672us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.579041:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 248 00000100:00100000:2.0:1789120779.591890:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120779.592542:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310720 00000100:00100000:3.0:1789120779.592552:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310720 00000100:00100000:3.0:1789120779.592609:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 249 00000100:00100000:3.0:1789120779.592620:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:9510:x1876028901310720:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120779.592874:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:9510:x1876028901310720:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 255us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120779.592882:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 249 00000100:00100000:3.0:1789120779.595412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120779.595555:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310848 00000100:00100000:0.0:1789120779.595563:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310848 00000100:00100000:0.0:1789120779.595619:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 250 00000100:00100000:0.0:1789120779.595628:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:9510:x1876028901310848:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120779.600269:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:9510:x1876028901310848:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 4634us (4856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.600283:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 250 00000100:00100000:1.0:1789120779.609478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120779.613551:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901310976 00000100:00100000:3.0:1789120779.613565:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901310976 00000100:00100000:3.0:1789120779.613616:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 251 00000100:00100000:3.0:1789120779.613626:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901310976:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120779.613642:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120779.613658:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad19 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120779.613695:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120779.613707:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120779.613716:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:3.0:1789120779.613777:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901310976:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 153us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120779.613784:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 251 00000100:00100000:3.0:1789120779.621215:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120779.621326:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311104 00000100:00100000:2.0:1789120779.621336:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311104 00000100:00100000:2.0:1789120779.621441:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 252 00000100:00100000:2.0:1789120779.621452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901311104:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120779.622509:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901311104:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 1054us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.622520:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 252 00000100:00100000:2.0:1789120779.638048:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120779.638110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311232 00000100:00100000:3.0:1789120779.638120:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311232 00000100:00100000:3.0:1789120779.638200:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 253 00000100:00100000:3.0:1789120779.638210:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901311232:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120779.638402:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901311232:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 193us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120779.638410:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 253 00000100:00100000:1.0:1789120779.655111:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120779.656729:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311360 00000100:00100000:2.0:1789120779.656741:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311360 00000100:00100000:2.0:1789120779.656801:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 254 00000100:00100000:2.0:1789120779.656810:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:9513:x1876028901311360:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120779.657054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:9513:x1876028901311360:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 244us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.657062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 254 00000100:00100000:2.0:1789120779.664862:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120779.664927:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311488 00000100:00100000:1.0:1789120779.664937:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311488 00000100:00100000:1.0:1789120779.664993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 255 00000100:00100000:1.0:1789120779.665003:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:9513:x1876028901311488:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120779.665355:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:9513:x1876028901311488:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 352us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.665364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 255 10000000:01000000:1.0:1789120780.331174:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120780.331181:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdbfb5a800 from 7 10000000:01000000:1.0:1789120780.331186:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120780.331240:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120780.331252:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120780.331264:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120780.331290:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120780.331372:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120780.331547:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.331966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318336 00000100:00100000:2.0:1789120780.331973:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318336 00000100:00100000:2.0:1789120780.332077:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789120780.332086:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922318336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120780.332101:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120780.332115:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e5e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.332178:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.332189:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.332197:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4a00, rc 0) 00000100:00100000:2.0:1789120780.332261:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.332268:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789120780.332358:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120780.332380:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120780.332389:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120780.332444:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120780.332476:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120780.332811:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120780.332960:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318464 00000100:00100000:1.0:1789120780.332965:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318464 00000100:00100000:1.0:1789120780.332990:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789120780.332997:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120780.333317:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120780.333325:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789120780.333501:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120780.333537:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120780.333581:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120780.333614:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120780.333665:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318592 00000100:00100000:1.0:1789120780.333669:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318592 00000100:00100000:1.0:1789120780.333776:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789120780.333783:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120780.334113:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 329us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120780.334120:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789120780.334384:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120780.334796:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11678:1876028922318720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120780.334841:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120780.334925:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120780.335102:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318720 00000100:00100000:0.0:1789120780.335108:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318720 00000100:00100000:2.0:1789120780.335180:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789120780.335190:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:11678:x1876028922318720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.335370:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:11678:x1876028922318720:12345-0@lo:502:llog_process_th.0 Request processed in 181us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.335377:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789120780.335470:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11678:1876028922318720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120780.335494:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120780.335504:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120780.335507:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120780.335513:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdbfb5a800 00000020:00000080:3.0:1789120780.335515:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120780.335590:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11678:1876028922318848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120780.335626:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120780.335664:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbdc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.335786:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318848 00000100:00100000:2.0:1789120780.335791:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318848 00000100:00100000:2.0:1789120780.335818:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789120780.335825:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:11678:x1876028922318848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.335957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:11678:x1876028922318848:12345-0@lo:502:llog_process_th.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.335972:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789120780.336979:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11678:1876028922318848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120780.337010:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120780.337017:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120780.337019:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789120780.337023:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789120780.337796:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789120780.337816:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120780.337825:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.337835:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120780.337844:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120780.337847:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaf537000 from 7 10000000:01000000:2.0:1789120780.337849:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120780.337877:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.337884:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.337892:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120780.337908:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.337954:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.337990:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.338008:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922318976 00000100:00100000:2.0:1789120780.338013:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922318976 00000100:00100000:2.0:1789120780.338044:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789120780.338053:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922318976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120780.338063:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120780.338083:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e6c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.338104:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.338114:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.338123:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120780.338192:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922318976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.338199:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789120780.338234:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922318976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120780.338247:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120780.338255:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120780.338296:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.338321:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.338333:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.338345:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319104 00000100:00100000:2.0:1789120780.338348:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319104 00000100:00100000:2.0:1789120780.338365:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789120780.338371:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922319104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.338565:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922319104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.338579:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789120780.338607:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.338631:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.338666:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.340778:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.340808:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319232 00000100:00100000:2.0:1789120780.340815:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319232 00000100:00100000:2.0:1789120780.340851:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789120780.340859:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922319232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.341062:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922319232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.341070:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789120780.341115:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.341342:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11680:1876028922319360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.341378:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.341395:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319360 00000100:00100000:2.0:1789120780.341398:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319360 00000100:00100000:2.0:1789120780.341415:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789120780.341421:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:11680:x1876028922319360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.341526:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:11680:x1876028922319360:12345-0@lo:502:llog_process_th.0 Request processed in 105us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120780.341533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789120780.341556:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.341565:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11680:1876028922319360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120780.341588:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120780.341598:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120780.341601:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120780.341607:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdaf537000 00000020:00000080:2.0:1789120780.341609:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120780.341671:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11680:1876028922319488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.344228:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.344269:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319488 00000100:00100000:2.0:1789120780.344277:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319488 00000100:00100000:2.0:1789120780.344325:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789120780.344419:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120780.345124:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:11680:x1876028922319488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.345408:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:11680:x1876028922319488:12345-0@lo:502:llog_process_th.0 Request processed in 1073us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.346929:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11680:1876028922319488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120780.346967:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120780.346976:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120780.346978:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789120780.346983:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789120780.347113:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789120780.347128:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120780.347166:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347177:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120780.347187:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120780.347195:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 7 10000000:01000000:0.0:1789120780.347197:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120780.347230:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347238:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347248:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120780.347267:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120780.347323:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120780.347358:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb97b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120780.347379:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319616 00000100:00100000:0.0:1789120780.347383:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319616 00000100:00100000:0.0:1789120780.347417:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789120780.347425:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922319616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120780.347437:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120780.347447:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4e7a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347470:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347480:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347487:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120780.347518:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:5854:x1876028922319616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.347530:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789120780.347568:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120780.347580:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.347589:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120780.349117:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120780.349191:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120780.349218:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb97b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120780.349244:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319744 00000100:00100000:0.0:1789120780.349249:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319744 00000100:00100000:0.0:1789120780.349278:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789120780.349286:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:5854:x1876028922319744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120780.349522:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+20:5854:x1876028922319744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.349529:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789120780.349570:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120780.349601:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.350458:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789120780.351556:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120780.351600:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb97b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120780.351643:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922319872 00000100:00100000:0.0:1789120780.351651:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922319872 00000100:00100000:0.0:1789120780.351695:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789120780.351713:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922319872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120780.353277:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922319872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1561us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.353288:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789120780.354319:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120780.356750:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11682:1876028922320000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.356832:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.356879:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120780.356980:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320000 00000100:00100000:3.0:1789120780.356987:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320000 00000100:00100000:3.0:1789120780.357043:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789120780.357051:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:11682:x1876028922320000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120780.357310:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:11682:x1876028922320000:12345-0@lo:502:llog_process_th.0 Request processed in 259us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120780.357318:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789120780.357644:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11682:1876028922320000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120780.357671:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120780.357836:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120780.357839:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120780.357850:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd85287800 00000020:00000080:2.0:1789120780.357852:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120780.357948:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11682:1876028922320128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120780.357996:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120780.358973:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda024a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120780.360114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320128 00000100:00100000:3.0:1789120780.360124:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320128 00000100:00100000:3.0:1789120780.360197:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789120780.360206:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:11682:x1876028922320128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120780.360451:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:11682:x1876028922320128:12345-0@lo:502:llog_process_th.0 Request processed in 245us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120780.360461:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789120780.360476:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:11682:1876028922320128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120780.360511:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120780.360518:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120780.360521:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789120780.360526:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789120780.360955:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789120780.360976:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120780.360985:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120780.361007:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120780.524928:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120781.036672:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922320256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120781.036737:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120781.036804:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120781.036813:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922320384:0@lo:400:kworker.0 00000100:00100000:1.0:1789120781.036836:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922320896:0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.036852:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120781.036876:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120781.036888:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922320768:0@lo:400:kworker.0 00000100:00100000:1.0:1789120781.036915:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922320512:0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.036930:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120781.036952:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120781.036970:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320768 00000100:00100000:2.0:1789120781.036977:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320768 00000100:00100000:1.0:1789120781.036978:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120781.036985:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922320640:0@lo:400:kworker.0 00000100:00100000:1.0:1789120781.037022:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120781.037055:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320896 00000100:00100000:1.0:1789120781.037059:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320896 00000100:00100000:1.0:1789120781.037093:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320512 00000100:00100000:1.0:1789120781.037103:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320512 00000100:00100000:1.0:1789120781.037118:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320640 00000100:00100000:1.0:1789120781.037121:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320640 00000100:00100000:1.0:1789120781.037172:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789120781.037176:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320256 00000100:00100000:3.0:1789120781.037182:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320256 00000100:00100000:1.0:1789120781.037182:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922320896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120781.037222:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120781.037233:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922320256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120781.037261:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120781.037302:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922320256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120781.037308:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120781.037329:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922320384 00000100:00100000:3.0:1789120781.037332:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922320384 00000100:00100000:3.0:1789120781.037356:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789120781.037365:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120781.037412:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922320384:12345-0@lo:400:kworker.0 Request processed in 48us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120781.037419:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789120781.037747:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922320896:12345-0@lo:400:kworker.0 Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120781.037755:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789120781.037772:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789120781.037780:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120781.037829:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922320512:12345-0@lo:400:kworker.0 Request processed in 50us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120781.037835:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789120781.037847:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789120781.037854:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922320640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120781.037880:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922320640:12345-0@lo:400:kworker.0 Request processed in 28us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120781.037886:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789120781.037927:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922320896:0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.038382:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789120781.038393:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922320768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.038434:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922320768:12345-0@lo:400:kworker.0 Request processed in 44us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120781.038441:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789120781.038463:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120781.038468:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120781.038471:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120781.038504:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5fc4780 x1876028922320768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120781.038516:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922320768:0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.038528:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922320384:0@lo:400:kworker.0 00010000:00080000:2.0:1789120781.038877:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5dda580 x1876028922320256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120781.038904:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922320256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120781.038940:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922320640:0@lo:400:kworker.0 00000100:00100000:2.0:1789120781.039035:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922320512:0@lo:400:kworker.0 00010000:00010000:2.0:1789120781.550172:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120781.750981:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120781.751027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120781.751056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120781.751225:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311616 00000100:00100000:3.0:1789120781.751235:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311616 00000100:00100000:3.0:1789120781.751284:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 272 00000100:00100000:3.0:1789120781.751293:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901311616:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120781.751367:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901311616:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 75us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120781.751389:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 272 00000100:00100000:1.0:1789120781.751778:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311744 00000100:00100000:1.0:1789120781.751783:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311744 00000100:00100000:3.0:1789120781.751957:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901311872 00000100:00100000:3.0:1789120781.751961:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901311872 00000100:00100000:3.0:1789120781.751983:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:3.0:1789120781.751990:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901311744:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120781.752029:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901311744:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 39us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120781.752035:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:3.0:1789120781.752047:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789120781.752053:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901311872:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120781.752074:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901311872:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 21us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120781.752325:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00080000:2.0:1789120781.752775:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120782.573805:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120783.594736:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120784.528482:0:11819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:59:42 (1789120782) === 00000100:00100000:0.0:1789120784.618513:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922321024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120784.618576:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120784.618630:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321024 00000100:00100000:1.0:1789120784.618637:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321024 00000100:00100000:1.0:1789120784.618704:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789120784.618716:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922321024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120784.618747:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120784.618799:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922321024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120784.618814:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789120784.618828:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffd91e68780 x1876028922321024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789120784.618841:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120784.618851:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922321024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789120784.620140:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120785.645458:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120786.146340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.146485:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.146843:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312128 00000100:00100000:2.0:1789120786.146852:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312128 00000100:00100000:2.0:1789120786.146923:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789120786.146933:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:9880:x1876028901312128:12345-192.168.206.9@tcp:700:mkdir.0 00000100:00100000:2.0:1789120786.147014:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:9880:x1876028901312128:12345-192.168.206.9@tcp:700:mkdir.0 Request processed in 81us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120786.147021:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00080000:0.0:1789120786.149966:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120786.150880:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312000 00000100:00100000:3.0:1789120786.150901:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312000 00000100:00100000:3.0:1789120786.150963:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:3.0:1789120786.150973:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901312000:12345-192.168.206.9@tcp:41:mkdir.0 00000004:00000024:3.0:1789120786.151014:0:5857:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789120786.151334:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901312000:12345-192.168.206.9@tcp:41:mkdir.0 Request processed in 362us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.151352:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:3.0:1789120786.153997:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.154130:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312384 00000100:00100000:1.0:1789120786.154138:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312384 00000100:00100000:1.0:1789120786.154216:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789120786.154225:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:9880:x1876028901312384:12345-192.168.206.9@tcp:36:mkdir.0 00010000:00010000:1.0:1789120786.154274:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120786.154344:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ac00/0x13cfa3d77faa4d2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac8d expref: 6 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154361:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd84cf3c00) 00010000:00010000:1.0:1789120786.154371:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120786.154689:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154702:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154711:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154723:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154730:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.154736:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.155980:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789120786.155993:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156002:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156009:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156014:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.156018:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156026:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156038:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:1.0:1789120786.156041:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.156045:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.156051:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4e88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120786.156066:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000066014c1b reply state 000000006368aefd transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.156073:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120786.156201:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9880:x1876028901312384:12345-192.168.206.9@tcp:36:mkdir.0 Request processed in 1973us (2207us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789120786.156219:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789120786.157754:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120786.157772:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120786.157828:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120786.158053:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321152 00000100:00100000:3.0:1789120786.158069:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321152 00000100:00100000:3.0:1789120786.158196:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120786.158206:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922321152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120786.158249:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120786.158294:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922321152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.158301:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789120786.158340:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5dd9680 x1876028922321152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120786.158358:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120786.161303:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922321408:0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.161353:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120786.161386:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789120786.161391:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.161414:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120786.161441:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922321792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.161458:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120786.161487:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321280 00000100:00100000:3.0:1789120786.161502:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321280 00000100:00100000:3.0:1789120786.161544:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789120786.161553:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922321280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.161600:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922321280:12345-0@lo:400:kworker.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.161608:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789120786.161638:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321408 00000100:00100000:3.0:1789120786.161642:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321408 00000100:00100000:1.0:1789120786.162222:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321792 00000100:00100000:1.0:1789120786.162228:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321792 00000100:00100000:1.0:1789120786.162264:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789120786.162272:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922321792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120786.162311:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922321792:12345-0@lo:400:kworker.0 Request processed in 40us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.162317:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789120786.162340:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922321664:0@lo:400:kworker.0 00000100:00100000:1.0:1789120786.162368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120786.162389:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120786.162395:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922321536:0@lo:400:kworker.0 00000100:00100000:1.0:1789120786.162415:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120786.162438:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321536 00000100:00100000:1.0:1789120786.162442:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321536 00000100:00100000:1.0:1789120786.162464:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789120786.162471:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922321536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120786.162505:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922321536:12345-0@lo:400:kworker.0 Request processed in 35us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.162511:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789120786.162543:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922321536:0@lo:400:kworker.0 00000100:00080000:2.0:1789120786.162729:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120786.162735:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120786.162771:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162782:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162790:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162802:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120786.162807:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162815:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162829:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffd82a3f700) 00010000:00010000:2.0:1789120786.162832:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120786.162836:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.162843:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4e8f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120786.162871:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321664 00000100:00100000:2.0:1789120786.162874:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321664 00000100:00100000:3.0:1789120786.164005:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120786.164019:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922321408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120786.164357:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120786.164365:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922321664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120786.164423:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922321664:12345-0@lo:400:kworker.0 Request processed in 59us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120786.164429:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789120786.164472:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5dd92c0 x1876028922321664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120786.164487:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922321664:0@lo:400:kworker.0 00000100:00080000:2.0:1789120786.164510:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120786.164574:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922321408:12345-0@lo:400:kworker.0 Request processed in 559us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.164582:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120786.164619:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.164633:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922321792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120786.164642:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922321408:0@lo:400:kworker.0 00000100:00100000:2.0:1789120786.199191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120786.200593:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312512 00000100:00100000:3.0:1789120786.200610:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312512 00000100:00100000:3.0:1789120786.200700:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120786.200710:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:9881:x1876028901312512:12345-192.168.206.9@tcp:101:chmod.0 00010000:00010000:3.0:1789120786.200732:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120786.200759:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa4e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad20 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.200827:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.200854:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.200868:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120786.200934:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789120786.200938:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120786.200977:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.201001:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa4e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad20 expref: 8 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.201018:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad20 expref: 7 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.201027:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cf400) 00010000:00010000:3.0:1789120786.201030:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120786.201033:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120786.201095:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9881:x1876028901312512:12345-192.168.206.9@tcp:101:chmod.0 Request processed in 386us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.201112:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120786.204430:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.208950:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312768 00000100:00100000:2.0:1789120786.208975:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312768 00000100:00100000:2.0:1789120786.209029:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:2.0:1789120786.209040:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9881:x1876028901312768:12345-192.168.206.9@tcp:36:chmod.0 00010000:00010000:2.0:1789120786.209093:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120786.209135:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa4e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad20 expref: 7 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.209170:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cf400) 00010000:00010000:2.0:1789120786.209181:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120786.209208:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.209220:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.209228:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120786.209546:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f30af148 reply state 000000008a2497c5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120786.209556:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789120786.209571:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789120786.209666:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:9881:x1876028901312768:12345-192.168.206.9@tcp:36:chmod.0 Request processed in 627us (5244us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789120786.209674:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00010000:00010000:1.0:1789120786.219049:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219068:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219090:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219112:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.219118:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219126:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219295:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd84cf3700) 00010000:00010000:1.0:1789120786.219300:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120786.219305:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.219312:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5400/0x13cfa3d77faa4ea4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120786.263245:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.263339:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901312896 00000100:00100000:1.0:1789120786.263348:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901312896 00000100:00100000:1.0:1789120786.263411:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789120786.263421:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9882:x1876028901312896:12345-192.168.206.9@tcp:101:chown.0 00010000:00010000:1.0:1789120786.263444:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120786.263464:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad27 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263533:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263548:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263569:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.263635:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789120786.263639:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120786.263683:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263712:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad27 expref: 9 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263728:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad27 expref: 8 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.263737:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:1.0:1789120786.263740:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120786.263743:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb000, rc 0) 00000100:00100000:1.0:1789120786.263803:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:9882:x1876028901312896:12345-192.168.206.9@tcp:101:chown.0 Request processed in 384us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.263809:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789120786.276803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.276884:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901313024 00000100:00100000:0.0:1789120786.276895:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901313024 00000100:00100000:0.0:1789120786.276959:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789120786.276970:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:9882:x1876028901313024:12345-192.168.206.9@tcp:101:chown.0 00010000:00010000:0.0:1789120786.276991:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120786.277015:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa4eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad2e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277081:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277095:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277120:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277135:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277186:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277194:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277298:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277307:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277315:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120786.277353:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789120786.277356:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120786.277383:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277396:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277403:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277409:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277415:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120786.277418:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277432:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277443:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:0.0:1789120786.277446:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120786.277451:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277458:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa4ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277470:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277477:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277483:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277488:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120786.277490:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277495:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277502:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffd9fd7c700) 00010000:00010000:0.0:1789120786.277505:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120786.277508:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277524:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ec7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277554:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa4eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad2e expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277567:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad2e expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.277574:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd9fd7c900) 00010000:00010000:0.0:1789120786.277577:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120786.277579:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a200, rc 0) 00000100:00100000:0.0:1789120786.277635:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:9882:x1876028901313024:12345-192.168.206.9@tcp:101:chown.0 Request processed in 667us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120786.277642:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:1.0:1789120786.286955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.288603:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901313280 00000100:00100000:2.0:1789120786.288620:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901313280 00000100:00100000:2.0:1789120786.288687:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:2.0:1789120786.288711:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:9882:x1876028901313280:12345-192.168.206.9@tcp:36:chown.0 00010000:00010000:2.0:1789120786.288770:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120786.288796:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa4ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad2e expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.288815:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd9fd7c900) 00010000:00010000:2.0:1789120786.288826:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120786.288848:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.288860:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.288869:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120786.328924:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000413577b5 reply state 000000000fae8d26 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.328942:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789120786.329113:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000001:00080000:3.0:1789120786.329287:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1789120786.329303:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:1.0:1789120786.329382:0:5859:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789120786.329560:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9882:x1876028901313280:12345-192.168.206.9@tcp:36:chown.0 Request processed in 40845us (42674us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789120786.329580:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00010000:00010000:3.0:1789120786.329935:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.329950:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.329958:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.329964:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120786.329969:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.329975:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.329991:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:3.0:1789120786.329994:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789120786.329998:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.330005:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4ed5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.360767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120786.360864:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901313408 00000100:00100000:3.0:1789120786.360872:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901313408 00000100:00100000:3.0:1789120786.360935:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789120786.360945:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:9883:x1876028901313408:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:3.0:1789120786.360968:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120786.360989:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa4edc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad35 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120786.364406:0:8217:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3366us 00010000:00010000:1.0:1789120786.372343:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372363:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372374:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372389:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372395:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372400:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372818:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372827:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.372834:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.372916:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789120786.372920:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120786.373014:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373032:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373038:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373044:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373049:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.373053:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373060:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373072:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:1.0:1789120786.373075:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.373079:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373085:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4ee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373094:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373113:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373117:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373128:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.373130:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373136:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373168:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120786.373172:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.373175:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373181:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4eea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373388:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa4edc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad35 expref: 8 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373404:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad35 expref: 7 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.373411:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120786.373413:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789120786.373415:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bba00, rc 0) 00000100:00100000:1.0:1789120786.373631:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9883:x1876028901313408:12345-192.168.206.9@tcp:101:touch.500 Request processed in 12686us (12871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.373640:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:2.0:1789120786.379242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.379347:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901313664 00000100:00100000:1.0:1789120786.379370:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901313664 00000100:00100000:1.0:1789120786.379424:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:1.0:1789120786.379434:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:9883:x1876028901313664:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:1.0:1789120786.379455:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120786.379475:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4ef8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad3c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379813:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379830:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379840:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379899:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379907:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.379913:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120786.383366:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789120786.383647:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383663:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383686:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383727:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383733:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383741:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383747:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.383751:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383758:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383771:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120786.383774:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.383779:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383786:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa4eff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120786.383797:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002136f551 reply state 00000000006e56d6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.383806:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789120786.383848:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa4ef8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad3c expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383862:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad3c expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.383869:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120786.383872:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120786.383874:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb600, rc 0) 00000100:00100000:1.0:1789120786.383962:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:9883:x1876028901313664:12345-192.168.206.9@tcp:101:touch.500 Request processed in 4528us (4767us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789120786.383971:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00010000:00010000:1.0:1789120786.386059:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386073:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386080:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386086:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.386090:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386107:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386121:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120786.386124:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.386139:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.386175:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120786.389311:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.389775:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901313920 00000100:00100000:0.0:1789120786.389784:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901313920 00000100:00100000:0.0:1789120786.389842:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789120786.389853:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:9883:x1876028901313920:12345-192.168.206.9@tcp:36:touch.500 00010000:00010000:0.0:1789120786.389911:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120786.389939:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa4f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad3c expref: 9 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.389959:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:0.0:1789120786.389970:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120786.390013:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.390038:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.390047:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120786.390299:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000afd2cae7 reply state 00000000b048b125 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120786.390308:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120786.390396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:9883:x1876028901313920:12345-192.168.206.9@tcp:36:touch.500 Request processed in 544us (1094us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789120786.390404:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00010000:00010000:3.0:1789120786.391949:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.391962:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.391970:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.391976:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120786.391981:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.391988:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.392003:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd9fd7c700) 00010000:00010000:3.0:1789120786.392006:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120786.392010:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.392017:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4f1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120786.396314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.396591:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314048 00000100:00100000:1.0:1789120786.396601:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314048 00000100:00100000:1.0:1789120786.396667:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:1.0:1789120786.396678:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:9883:x1876028901314048:12345-192.168.206.9@tcp:101:touch.500 00010000:00010000:1.0:1789120786.396700:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120786.396722:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad43 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.396783:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad43 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.396797:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad43 expref: 10 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.396816:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120786.396820:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120786.396824:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bae00, rc 0) 00000100:00100000:1.0:1789120786.396882:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:9883:x1876028901314048:12345-192.168.206.9@tcp:101:touch.500 Request processed in 206us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.396894:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:0.0:1789120786.409404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.409492:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314176 00000100:00100000:1.0:1789120786.409502:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314176 00000100:00100000:1.0:1789120786.409551:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789120786.409572:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1876028901314176:12345-192.168.206.9@tcp:8:touch.500 00010000:00080000:1.0:1789120786.409600:0:8216:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1789120786.409630:0:8216:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa4f29 00002000:00100000:1.0:1789120786.409640:0:8216:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76510092-6f58-4075-a7f3-7af5ca8b7da2/ffff9ffd9d399800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120786.409660:0:8216:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789120786.409876:0:8216:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120786.409907:0:8216:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d39b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120786.410020:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901314176:12345-192.168.206.9@tcp:8:touch.500 Request processed in 447us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.410027:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789120786.420884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.420983:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314304 00000100:00100000:0.0:1789120786.420992:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314304 00000100:00100000:0.0:1789120786.421062:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789120786.421071:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:0:x1876028901314304:12345-192.168.206.9@tcp:2:touch.500 00000100:00080000:2.0:1789120786.421831:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789120786.452512:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1789120786.452527:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000100:00100000:3.0:1789120786.452828:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:0:x1876028901314304:12345-192.168.206.9@tcp:2:touch.500 Request processed in 31752us (31948us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789120786.452841:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:2.0:1789120786.455835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.455934:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314560 00000100:00100000:0.0:1789120786.455943:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314560 00000100:00100000:0.0:1789120786.456026:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789120786.456035:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:9883:x1876028901314560:12345-192.168.206.9@tcp:35:touch.500 00000100:00100000:0.0:1789120786.456514:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:9883:x1876028901314560:12345-192.168.206.9@tcp:35:touch.500 Request processed in 479us (687us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789120786.456523:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789120786.468819:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.468888:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314688 00000100:00100000:2.0:1789120786.468908:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314688 00000100:00100000:2.0:1789120786.468967:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:2.0:1789120786.468976:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:9885:x1876028901314688:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:2.0:1789120786.468998:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120786.469020:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad4a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469113:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469127:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469138:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120786.469430:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789120786.469435:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120786.469482:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469511:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa4f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad4a expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469527:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad4a expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.469535:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:2.0:1789120786.469538:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120786.469541:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5200, rc 0) 00000100:00100000:2.0:1789120786.469607:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:9885:x1876028901314688:12345-192.168.206.9@tcp:101:rm.0 Request processed in 632us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120786.469615:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789120786.474522:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.474782:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901314944 00000100:00100000:2.0:1789120786.474792:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901314944 00000100:00100000:2.0:1789120786.474864:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:2.0:1789120786.474874:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:9885:x1876028901314944:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:2.0:1789120786.474969:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120786.474991:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa4f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad51 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120786.476535:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789120786.476755:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa4f3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad51 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.476773:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120786.476776:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120786.476782:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa4f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad51 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120786.476798:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4400, rc 0) 00000100:00100000:2.0:1789120786.476872:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:9885:x1876028901314944:12345-192.168.206.9@tcp:101:rm.0 Request processed in 1999us (2359us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789120786.476881:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:2.0:1789120786.482546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.482741:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901315072 00000100:00100000:0.0:1789120786.482760:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901315072 00000100:00100000:0.0:1789120786.482820:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789120786.482831:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:9885:x1876028901315072:12345-192.168.206.9@tcp:37:rm.0 00000100:00100000:2.0:1789120786.496517:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:9885:x1876028901315072:12345-192.168.206.9@tcp:37:rm.0 Request processed in 13675us (13970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120786.496533:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789120786.502854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.503002:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901315328 00000100:00100000:2.0:1789120786.503013:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901315328 00000100:00100000:2.0:1789120786.503074:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789120786.503084:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:9885:x1876028901315328:12345-192.168.206.9@tcp:35:rm.0 00000100:00100000:2.0:1789120786.503400:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:9885:x1876028901315328:12345-192.168.206.9@tcp:35:rm.0 Request processed in 317us (553us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789120786.503408:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:0.0:1789120786.508710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.508799:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901315584 00000100:00100000:1.0:1789120786.508808:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901315584 00000100:00100000:1.0:1789120786.508862:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:1.0:1789120786.508871:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:9885:x1876028901315584:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:1.0:1789120786.508894:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120786.508915:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad58 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.509038:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa4f53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.509050:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa4f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.509075:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa4f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.509087:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789120786.509261:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad58 expref: 17 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.509279:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa4f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad58 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.509287:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120786.509289:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120786.509293:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba400, rc 0) 00000100:00100000:1.0:1789120786.509346:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901315584:12345-192.168.206.9@tcp:101:rm.0 Request processed in 475us (646us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789120786.509353:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:1.0:1789120786.516555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120786.516684:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901315712 00000100:00100000:0.0:1789120786.516695:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901315712 00000100:00100000:0.0:1789120786.516826:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:0.0:1789120786.516839:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901315712:12345-192.168.206.9@tcp:41:rm.0 00000004:00000024:0.0:1789120786.516922:0:5858:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789120786.517024:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5906940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901315712:12345-192.168.206.9@tcp:41:rm.0 Request processed in 187us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120786.517033:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789120786.519376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.519436:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901315840 00000100:00100000:1.0:1789120786.519445:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901315840 00000100:00100000:1.0:1789120786.519499:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:1.0:1789120786.519509:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901315840:12345-192.168.206.9@tcp:101:rm.0 00010000:00010000:1.0:1789120786.519527:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120786.519547:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa4f61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad5f expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519607:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519636:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519647:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519662:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519669:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519675:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519780:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519788:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519795:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.519821:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789120786.519825:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120786.519840:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519851:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519872:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519878:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519884:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519890:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.519893:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519901:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519913:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120786.519916:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.519920:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519925:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519937:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519943:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519949:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519959:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.519963:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519968:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519976:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120786.519978:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.519981:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.519986:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa4f6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.520015:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa4f61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad5f expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.520027:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad5f expref: 17 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.520035:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120786.520037:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120786.520039:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bbe00, rc 0) 00000100:00100000:1.0:1789120786.520110:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:9885:x1876028901315840:12345-192.168.206.9@tcp:101:rm.0 Request processed in 602us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.520117:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:1.0:1789120786.530570:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120786.530679:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316096 00000100:00100000:3.0:1789120786.530689:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316096 00000100:00100000:3.0:1789120786.530746:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:3.0:1789120786.530763:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:9885:x1876028901316096:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:3.0:1789120786.530819:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789120786.530845:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa4f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad5f expref: 17 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530868:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa4f22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad43 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530877:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120786.530892:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa4f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad4a expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530901:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:3.0:1789120786.530904:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120786.530923:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530934:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530943:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530957:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530964:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.530969:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.531082:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.531091:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.531108:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120786.532056:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789120786.532068:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 253785923532ns, next at 254785920881ns, rc = 0 00010000:00010000:3.0:1789120786.532141:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532429:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532440:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532448:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532454:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532461:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532520:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789120786.532548:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532563:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532570:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532576:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120786.532580:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532587:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532597:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd831cfb00) 00010000:00010000:3.0:1789120786.532600:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789120786.532604:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532610:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa4f8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532627:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532633:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532639:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532644:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120786.532651:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532657:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532665:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:3.0:1789120786.532667:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120786.532669:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.532675:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b000/0x13cfa3d77faa4f7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120786.532684:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002f55ecb6 reply state 000000001ba3a751 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120786.532692:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120786.532776:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901316096:12345-192.168.206.9@tcp:36:rm.0 Request processed in 2011us (2213us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789120786.532785:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00010000:00010000:0.0:1789120786.534619:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120786.534631:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.534698:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120786.534704:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.534713:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.534730:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ffd831cfb00) 00010000:00010000:0.0:1789120786.534733:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789120786.534738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.534745:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa4f92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.534873:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120786.534876:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120786.534878:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120786.535533:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535544:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535551:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535556:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.535560:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535567:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535579:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9ffd831cfa00) 00010000:00010000:1.0:1789120786.535581:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.535584:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.535591:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa4f84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.536987:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.537066:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316352 00000100:00100000:2.0:1789120786.537075:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316352 00000100:00100000:2.0:1789120786.537128:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789120786.537137:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:9885:x1876028901316352:12345-192.168.206.9@tcp:35:rm.0 00000100:00100000:2.0:1789120786.537669:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901316352:12345-192.168.206.9@tcp:35:rm.0 Request processed in 530us (686us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789120786.537741:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789120786.543510:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.545543:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316608 00000100:00100000:1.0:1789120786.545556:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316608 00000100:00100000:1.0:1789120786.545647:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789120786.545657:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:9885:x1876028901316608:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:1.0:1789120786.545723:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789120786.545748:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa4f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad58 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545767:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa4ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad35 expref: 15 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545777:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120786.545791:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa4eb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad27 expref: 14 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545799:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:1.0:1789120786.545804:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120786.545825:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545836:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545845:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545855:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545862:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.545868:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.546189:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.546328:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.546339:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120786.548801:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789120786.548822:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.548833:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.548841:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.548847:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.548851:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.548859:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.548872:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120786.549068:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789120786.549075:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549093:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa4fa7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549133:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549139:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549186:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549191:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120786.549194:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549357:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549372:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120786.549375:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120786.549378:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120786.549384:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa4f99 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120786.549397:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f53ed636 reply state 00000000ab33ac62 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120786.549406:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120786.549551:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:9885:x1876028901316608:12345-192.168.206.9@tcp:36:rm.0 Request processed in 3891us (6047us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789120786.549561:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00010000:00010000:3.0:1789120786.551036:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551051:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551058:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551063:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120786.551066:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551084:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551109:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ffd82a3f700) 00010000:00010000:3.0:1789120786.551112:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120786.551116:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120786.551122:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa4fa0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120786.670764:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120786.866979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.867025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120786.867060:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120786.867181:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316864 00000100:00100000:1.0:1789120786.867191:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316864 00000100:00100000:0.0:1789120786.867211:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316992 00000100:00100000:0.0:1789120786.867218:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316992 00000100:00100000:1.0:1789120786.867248:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:1.0:1789120786.867259:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901316864:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120786.867270:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:0.0:1789120786.867280:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901316992:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:2.0:1789120786.867359:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120786.867851:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901316864:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 592us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120786.867860:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789120786.868055:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901316736 00000100:00100000:3.0:1789120786.868060:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901316736 00000100:00100000:3.0:1789120786.868109:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 274 00000100:00100000:3.0:1789120786.868117:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901316736:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120786.875073:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901316992:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 7783us (8035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120786.875089:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:3.0:1789120786.877812:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901316736:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 9684us (10831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120786.877827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 274 00010000:00010000:1.0:1789120787.690594:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120788.714583:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120789.739910:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789120789.740460:0:6738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256994314727ns, next at 257994311720ns, rc = 0 00000100:00100000:2.0:1789120789.740674:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922321920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120789.740765:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120789.741420:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922321920 00000100:00100000:1.0:1789120789.741433:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922321920 00000100:00100000:1.0:1789120789.741511:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120789.741523:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922321920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120789.741573:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120789.741638:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922321920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120789.741646:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789120789.741692:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120789.743390:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc4000 x1876028922321920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120789.743423:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922321920:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789120790.369550:0:12017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789120790.769816:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120791.275526:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922322176:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275623:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.275694:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922322688:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275731:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.275764:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789120791.275770:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922322048:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275801:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.275825:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922322560:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275850:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.275879:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922322432:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275927:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120791.275934:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922322304:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.275975:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322688 00000100:00100000:1.0:1789120791.275978:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.275986:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322688 00000100:00100000:1.0:1789120791.276006:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922322816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120791.276036:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.276059:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322432 00000100:00100000:2.0:1789120791.276064:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322432 00000100:00100000:1.0:1789120791.276088:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322176 00000100:00100000:1.0:1789120791.276101:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322176 00000100:00100000:2.0:1789120791.276107:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789120791.276121:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922322688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120791.276138:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322560 00000100:00100000:1.0:1789120791.276191:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322560 00000100:00100000:1.0:1789120791.276215:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322304 00000100:00100000:1.0:1789120791.276218:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322304 00000100:00100000:2.0:1789120791.276236:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922322688:12345-0@lo:400:kworker.0 Request processed in 118us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.276238:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789120791.276251:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922322176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.276261:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789120791.276287:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789120791.276296:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922322176:12345-0@lo:400:kworker.0 Request processed in 47us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120791.276297:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922322432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120791.276312:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789120791.276336:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789120791.276345:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922322560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.276348:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922322432:12345-0@lo:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120791.276358:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789120791.276383:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922322560:12345-0@lo:400:kworker.0 Request processed in 40us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120791.276387:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322048 00000100:00100000:1.0:1789120791.276392:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789120791.276394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322048 00000100:00100000:1.0:1789120791.276410:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789120791.276419:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922322304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.276431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789120791.276442:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120791.276459:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5907840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922322304:12345-0@lo:400:kworker.0 Request processed in 41us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.276467:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789120791.276497:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922322048:12345-0@lo:400:kworker.0 Request processed in 55us (693us total) trans 0 rc 0/0 00000100:00080000:1.0:1789120791.276498:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120791.276506:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120791.276510:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1789120791.276511:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120791.276526:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322816 00000100:00100000:1.0:1789120791.276531:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322816 00000100:00100000:1.0:1789120791.276565:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120791.276573:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922322816:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789120791.276579:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafe9c000 x1876028922322432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120791.276598:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922322432:0@lo:400:kworker.0 00002000:00000024:1.0:1789120791.276642:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120791.276658:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922322048:0@lo:400:kworker.0 00000100:00100000:2.0:1789120791.276672:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922322560:0@lo:400:kworker.0 00010000:00080000:2.0:1789120791.276687:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafe9cf00 x1876028922322688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120791.276697:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922322816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120791.276702:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922322688:0@lo:400:kworker.0 00000100:00100000:1.0:1789120791.276713:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789120791.276722:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922322176:0@lo:400:kworker.0 00000100:00100000:1.0:1789120791.276771:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922322304:0@lo:400:kworker.0 00010000:00080000:1.0:1789120791.276785:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb5905a40 x1876028922322816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120791.276800:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5905a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922322816:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789120791.601963:0:12065:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff82ac1c70 20000000:00000080:3.0:1789120791.601985:0:12065:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdb5fa3c00 uarg=0000000000000000 20000000:01000000:3.0:1789120791.602028:0:12065:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789120791.602036:0:12065:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789120791.602041:0:12065:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789120791.605558:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789120791.605767:0:12065:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789120791.611648:0:12065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:3.0:1789120791.611730:0:12065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:3.0:1789120791.611771:0:12065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:3.0:1789120791.611789:0:12065:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789120791.611820:0:12065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611843:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611852:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611860:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611867:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611873:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611880:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611925:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.611942:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 18 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.611958:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922322944:0@lo:104: 00000100:00100000:3.0:1789120791.612034:0:12065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120791.612114:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.612133:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.612178:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323072:0@lo:104: 00000100:00100000:3.0:1789120791.612203:0:12065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120791.612245:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.612253:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 18 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.612261:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323200:0@lo:104: 00000100:00100000:1.0:1789120791.612270:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922322944 00000100:00100000:1.0:1789120791.612279:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922322944 00000100:00100000:3.0:1789120791.612281:0:12065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120791.612298:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.612307:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.612315:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323328:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120791.612321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323072 00000100:00100000:1.0:1789120791.612324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323072 00000100:00100000:1.0:1789120791.612333:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323200 00000100:00100000:1.0:1789120791.612335:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323200 00000100:00100000:1.0:1789120791.612347:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120791.612355:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:12065:x1876028922322944:12345-0@lo:104: 00010000:00010000:1.0:1789120791.612371:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.612379:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.612386:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.612393:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323456:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120791.612413:0:12065:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789120791.612427:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120791.612432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+5:12065:x1876028922322944:12345-0@lo:104: Request processed in 78us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.612439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789120791.612442:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922322944:0@lo:104: 00000100:00100000:1.0:1789120791.612462:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789120791.612468:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:12065:x1876028922323072:12345-0@lo:104: 00010000:00010000:1.0:1789120791.612476:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612533:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789120791.612539:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+4:12065:x1876028922323072:12345-0@lo:104: Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.612545:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789120791.612558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789120791.612564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:12065:x1876028922323200:12345-0@lo:104: 00010000:00010000:1.0:1789120791.612572:0:5840:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612600:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789120791.612605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+3:12065:x1876028922323200:12345-0@lo:104: Request processed in 41us (323us total) trans 0 rc 0/0 00010000:00010000:0.0:1789120791.612605:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789120791.612610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789120791.612613:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612621:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b000 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120791.612626:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612636:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120791.612639:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120791.612646:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120791.612652:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789120791.612684:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612701:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120791.612725:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612732:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b000/0x13cfa3d77faa4e7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e81 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120791.612739:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789120791.612746:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789120791.612750:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922323584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.612750:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612756:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba000 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120791.612759:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612765:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120791.612772:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120791.612778:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789120791.612779:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120791.612792:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612798:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120791.612814:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612821:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba000/0x13cfa3d77faa4e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e65 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612836:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120791.612837:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120791.612839:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.612851:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120791.612854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323584 00010000:00010000:1.0:1789120791.612856:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.612857:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323584 00010000:00010000:1.0:1789120791.612862:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120791.612865:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612872:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612878:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120791.612888:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120791.612893:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789120791.612899:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120791.612905:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922323584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.612916:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120791.612921:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612922:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612928:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120791.612933:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612934:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612941:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4800/0x13cfa3d77faa4e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa4e73 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.612946:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4aa00/0x13cfa3d77faa4e81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e7a expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.612954:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.612955:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.612956:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120791.612957:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120791.612961:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.612963:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120791.612999:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3319:x1876028922323584:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120791.613005:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120791.613027:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922323712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120791.613052:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120791.613088:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120791.613094:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922323840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120791.613122:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120791.613171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323712 00000100:00100000:0.0:1789120791.613176:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323712 00010000:00010000:0.0:1789120791.613189:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 18 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.613202:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323840 00000100:00100000:0.0:1789120791.613204:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323840 00010000:00010000:0.0:1789120791.613213:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 19 pid: 5850 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.613224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120791.613230:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922323712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.613237:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120791.613241:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.613248:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 19 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.613269:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120791.613297:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922323712:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120791.613303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120791.613315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120791.613321:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922323840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.613329:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120791.613333:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.613353:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 18 pid: 5850 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.613362:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120791.613384:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922323840:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120791.613391:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120791.613419:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922323840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120791.613427:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922323712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120791.614106:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922323584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.614702:0:12065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa4e00/0x13cfa3d77faa4e73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e6c expref: 17 pid: 5850 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.614721:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323072:0@lo:104: 00010000:00010000:0.0:1789120791.614734:0:12065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa4a00/0x13cfa3d77faa4e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa4e5e expref: 16 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.614744:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323200:0@lo:104: 00000100:00100000:2.0:1789120791.615499:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323328:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120791.619479:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12065:1876028922323456:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120791.619529:0:12065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120791.627802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120791.628005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317248 00000100:00100000:3.0:1789120791.628018:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317248 00010000:00010000:3.0:1789120791.628077:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120791.628124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789120791.628136:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901317248:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120791.628209:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120791.628217:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.628231:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.628388:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5e00/0x13cfa3d77faa4e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad12 expref: 13 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120791.628406:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120791.628475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:2349:x1876028901317248:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 340us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120791.628484:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:1.0:1789120791.630598:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120791.631123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317120 00000100:00100000:0.0:1789120791.631136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317120 00010000:00010000:0.0:1789120791.631229:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120791.631361:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789120791.631372:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:2350:x1876028901317120:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120791.631391:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120791.631398:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631429:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631451:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390b600/0x13cfa3d77faa4e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad19 expref: 12 pid: 5850 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631472:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631481:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631501:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631509:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631516:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631523:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631529:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120791.631533:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631541:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631578:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120791.631591:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120791.631656:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e10de64a-96fd-4380-b3ad-f12a53725f77+11:2350:x1876028901317120:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 285us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120791.631665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00010000:00010000:2.0:1789120791.631807:0:12065:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.631817:0:12065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.631836:0:12065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390a400/0x13cfa3d77faa4fae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.788461:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789120791.876486:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000001:00080000:3.0:1789120791.876514:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789120791.876527:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789120791.876560:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789120791.886569:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120791.886607:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922323968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789120791.886705:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120791.886896:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922323968 00000100:00100000:2.0:1789120791.886906:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922323968 00000100:00100000:2.0:1789120791.886968:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120791.886978:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922323968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789120791.887016:0:6705:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789120791.887061:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3d112, atime: 0x6aa3d112, ctime: 0x6aa3d112, blocks: 0x1 00010000:00010000:2.0:1789120791.887080:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.887098:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1789120791.887104:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120791.887111:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.887132:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.887192:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.887202:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120791.887242:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120791.887802:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120791.887812:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.887824:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120791.887829:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.887854:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.887879:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.887887:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa4fb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120791.887910:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.887912:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120791.887913:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120791.892187:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1876028922323968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5197us (5469us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789120791.892207:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789120791.901329:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdafcc5a40/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789120791.901354:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922323968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789120791.984744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120791.984791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120791.985138:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317376 00000100:00100000:1.0:1789120791.985199:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317376 00000100:00100000:1.0:1789120791.985288:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:1.0:1789120791.985302:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901317376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:2.0:1789120791.985342:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120791.985416:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901317376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 117us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.985425:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:1.0:1789120791.985695:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317632 00000100:00100000:1.0:1789120791.985699:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317632 00000100:00100000:1.0:1789120791.985741:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:1.0:1789120791.985748:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901317632:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:0.0:1789120791.986401:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120791.986457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120791.987529:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317504 00000100:00100000:3.0:1789120791.987543:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317504 00000100:00080000:0.0:1789120791.987640:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120791.988817:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789120791.988835:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901317504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120791.988835:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901317632:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 2994us (3950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120791.988873:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:3.0:1789120791.989002:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901317504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 114us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120791.989012:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00010000:00010000:1.0:1789120792.812081:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789120793.002299:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120793.002310:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdbfb5a800 from 10 10000000:01000000:2.0:1789120793.002318:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120793.002387:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.002401:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.002414:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120793.002448:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.002538:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120793.002744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324096 00000100:00100000:3.0:1789120793.002754:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324096 00000100:00100000:3.0:1789120793.002834:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789120793.002846:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:5854:x1876028922324096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120793.002863:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120793.002880:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390b000/0x13cfa3d77faa4fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4fbc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.002910:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390b000/0x13cfa3d77faa4fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fbc expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.002921:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390b000/0x13cfa3d77faa4fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fbc expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.002932:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b000, rc 0) 00000100:00100000:3.0:1789120793.002978:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120793.002986:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789120793.003280:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120793.003309:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120793.003327:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.003336:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120793.003429:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.003462:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120793.003482:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120793.003556:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324224 00000100:00100000:1.0:1789120793.003561:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324224 00000100:00100000:1.0:1789120793.003599:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789120793.003607:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120793.003934:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.003942:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789120793.004744:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.004793:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.004847:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120793.004883:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120793.005011:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324352 00000100:00100000:3.0:1789120793.005024:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324352 00000100:00100000:3.0:1789120793.005082:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789120793.005091:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120793.005336:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120793.005344:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789120793.005500:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.007267:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12080:1876028922324480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120793.007367:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120793.007425:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120793.007658:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324480 00000100:00100000:1.0:1789120793.007666:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324480 00000100:00100000:1.0:1789120793.007839:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789120793.007850:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:12080:x1876028922324480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120793.008224:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:12080:x1876028922324480:12345-0@lo:502:llog_process_th.0 Request processed in 375us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.008232:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789120793.009106:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12080:1876028922324480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120793.009187:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120793.009201:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120793.009204:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789120793.009211:0:12080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdbfb5a800 00000020:00000080:0.0:1789120793.009214:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789120793.009384:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12080:1876028922324608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120793.009451:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120793.009506:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120793.011889:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324608 00000100:00100000:2.0:1789120793.011910:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324608 00000100:00100000:2.0:1789120793.012005:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789120793.012017:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:12080:x1876028922324608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120793.012415:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:12080:x1876028922324608:12345-0@lo:502:llog_process_th.0 Request processed in 399us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.012424:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789120793.013029:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12080:1876028922324608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120793.013093:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120793.013103:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120793.013115:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789120793.013120:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789120793.013856:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789120793.013889:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120793.013902:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.013916:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120793.013928:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120793.013942:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaf537000 from 10 10000000:01000000:2.0:1789120793.013945:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120793.013989:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.013998:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.014009:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120793.014035:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.014112:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120793.014204:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120793.014284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324736 00000100:00100000:3.0:1789120793.014292:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324736 00000100:00100000:3.0:1789120793.014346:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789120793.014357:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:5854:x1876028922324736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120793.014372:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120793.014387:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8390a200/0x13cfa3d77faa4fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4fca expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.014416:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8390a200/0x13cfa3d77faa4fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fca expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.014429:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8390a200/0x13cfa3d77faa4fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fca expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120793.014438:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a200, rc 0) 00000100:00100000:3.0:1789120793.014491:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922324736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120793.014499:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789120793.014626:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120793.014643:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120793.014652:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120793.014723:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.014752:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120793.014776:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120793.014880:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324864 00000100:00100000:3.0:1789120793.014884:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324864 00000100:00100000:3.0:1789120793.014915:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789120793.014923:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922324864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120793.015277:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922324864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120793.015286:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789120793.015637:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.015686:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.015756:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120793.015787:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120793.015957:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922324992 00000100:00100000:2.0:1789120793.015963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922324992 00000100:00100000:2.0:1789120793.016005:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789120793.016014:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922324992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.016264:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922324992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.016273:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789120793.016622:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5486d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922324992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120793.019288:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12082:1876028922325120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120793.019390:0:12082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120793.019452:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc81089f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120793.021673:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325120 00000100:00100000:2.0:1789120793.021692:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325120 00000100:00100000:2.0:1789120793.021759:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789120793.021770:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:12082:x1876028922325120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120793.022456:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:12082:x1876028922325120:12345-0@lo:502:llog_process_th.0 Request processed in 685us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.022467:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789120793.022590:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12082:1876028922325120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120793.022642:0:12082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120793.022655:0:12082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120793.022657:0:12082:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789120793.022665:0:12082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdaf537000 00000020:00000080:1.0:1789120793.022668:0:12082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789120793.022806:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12082:1876028922325248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120793.022857:0:12082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120793.022892:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325248 00000100:00100000:1.0:1789120793.022897:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325248 00000100:00100000:1.0:1789120793.022929:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789120793.022937:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:12082:x1876028922325248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120793.023094:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:12082:x1876028922325248:12345-0@lo:502:llog_process_th.0 Request processed in 157us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.023102:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789120793.023178:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf501f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120793.023193:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12082:1876028922325248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120793.023212:0:12082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120793.023217:0:12082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120793.023218:0:12082:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789120793.023222:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789120793.025973:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789120793.026029:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120793.026044:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.026070:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120793.026083:0:5854:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120793.026087:0:5854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 10 10000000:01000000:2.0:1789120793.026090:0:5854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120793.026140:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.026179:0:5854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.026193:0:5854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120793.026224:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.026307:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120793.026370:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120793.026795:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325376 00000100:00100000:0.0:1789120793.026806:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325376 00000100:00100000:0.0:1789120793.026877:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789120793.026889:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:5854:x1876028922325376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120793.026908:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120793.026929:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4fdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa4fd8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120793.026960:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fd8 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120793.026982:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa4fd8 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120793.026993:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b000, rc 0) 00000100:00100000:0.0:1789120793.027052:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922325376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.027070:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789120793.027117:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120793.027135:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.027162:0:5854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120793.027227:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120793.027268:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120793.027309:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120793.027358:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325504 00000100:00100000:0.0:1789120793.027362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325504 00000100:00100000:0.0:1789120793.027391:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789120793.027399:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922325504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.027695:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922325504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.027703:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789120793.027785:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120793.027823:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120793.027864:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120793.027890:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd957819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120793.027935:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325632 00000100:00100000:0.0:1789120793.027939:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325632 00000100:00100000:0.0:1789120793.027968:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789120793.027974:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922325632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.028172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:5854:x1876028922325632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.028179:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789120793.028256:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71bf207b-8b16-4d55-83e2-f8c047f616c0:5854:1876028922325632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120793.032523:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12084:1876028922325760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120793.032631:0:12084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120793.032700:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120793.032762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325760 00000100:00100000:1.0:1789120793.032771:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325760 00000100:00100000:1.0:1789120793.032829:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789120793.032840:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:12084:x1876028922325760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120793.033126:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:12084:x1876028922325760:12345-0@lo:502:llog_process_th.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.033135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789120793.033292:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12084:1876028922325760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120793.033330:0:12084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120793.033342:0:12084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120793.033345:0:12084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789120793.033355:0:12084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd85287800 00000020:00000080:3.0:1789120793.033358:0:12084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120793.033449:0:12084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12084:1876028922325888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120793.033483:0:12084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120793.033516:0:12084:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdc1b6f600 going to sleep for 11 seconds 00000040:00080000:0.0:1789120793.033891:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789120793.033905:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922325888 00000100:00100000:2.0:1789120793.033912:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922325888 00000100:00100000:2.0:1789120793.033953:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789120793.033963:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:12084:x1876028922325888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120793.034200:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:12084:x1876028922325888:12345-0@lo:502:llog_process_th.0 Request processed in 238us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.034207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789120793.034302:0:12084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71bf207b-8b16-4d55-83e2-f8c047f616c0:12084:1876028922325888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120793.034326:0:12084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120793.034332:0:12084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120793.034339:0:12084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789120793.034342:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789120793.034395:0:5854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789120793.034415:0:5854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120793.034426:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120793.034437:0:5854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120793.205293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120793.205476:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317760 00000100:00100000:1.0:1789120793.205490:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317760 00000100:00100000:1.0:1789120793.205671:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 291 00000100:00100000:1.0:1789120793.205685:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+11:5591:x1876028901317760:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120793.205740:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120793.205769:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa4fe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad66 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120793.205805:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa4fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad66 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120793.205818:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa4fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad66 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120793.205831:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba800, rc 0) 00000100:00100000:1.0:1789120793.208999:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901317760:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 3301us (3704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120793.213279:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120793.213415:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901317888 00000100:00100000:0.0:1789120793.213430:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901317888 00000100:00100000:1.0:1789120793.215879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 291 00000100:00100000:0.0:1789120793.218212:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 292 00000100:00100000:0.0:1789120793.218246:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901317888:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.218827:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901317888:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 595us (5559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.218838:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 292 00000100:00100000:3.0:1789120793.227189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120793.227424:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318016 00000100:00100000:1.0:1789120793.227438:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318016 00000100:00100000:1.0:1789120793.227508:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 293 00000100:00100000:1.0:1789120793.227519:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901318016:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120793.228402:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901318016:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 878us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.228414:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 293 00000100:00100000:3.0:1789120793.237899:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120793.245104:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318144 00000100:00100000:0.0:1789120793.245123:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318144 00000100:00100000:0.0:1789120793.245235:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 294 00000100:00100000:0.0:1789120793.245247:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:10155:x1876028901318144:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120793.245681:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:10155:x1876028901318144:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 434us (7794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.245691:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 294 00000100:00100000:3.0:1789120793.254933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120793.255087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318272 00000100:00100000:1.0:1789120793.255099:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318272 00000100:00100000:1.0:1789120793.255197:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 295 00000100:00100000:1.0:1789120793.255210:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:10155:x1876028901318272:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120793.255520:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+12:10155:x1876028901318272:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 312us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.255535:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 295 00000100:00100000:3.0:1789120793.263297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120793.263415:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318400 00000100:00100000:2.0:1789120793.263428:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318400 00000100:00100000:2.0:1789120793.263503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 296 00000100:00100000:2.0:1789120793.263516:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+12:5591:x1876028901318400:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120793.263540:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120793.263563:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4fed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad6d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.263614:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad6d expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.263628:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad6d expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120793.263640:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5400, rc 0) 00000100:00100000:2.0:1789120793.263716:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901318400:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 203us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.263735:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 296 00000100:00100000:3.0:1789120793.266218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120793.266337:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318528 00000100:00100000:0.0:1789120793.266351:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318528 00000100:00100000:0.0:1789120793.266423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 297 00000100:00100000:0.0:1789120793.266436:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901318528:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120793.267096:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901318528:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 658us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.267111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 297 00000100:00100000:3.0:1789120793.274424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120793.278069:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318656 00000100:00100000:1.0:1789120793.278089:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318656 00000100:00100000:1.0:1789120793.278201:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 298 00000100:00100000:1.0:1789120793.278214:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901318656:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120793.278521:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:5591:x1876028901318656:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 309us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120793.278531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 298 00000100:00100000:3.0:1789120793.281712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120793.282048:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318784 00000100:00100000:2.0:1789120793.282070:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318784 00000100:00100000:2.0:1789120793.282174:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 299 00000100:00100000:2.0:1789120793.282187:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:10158:x1876028901318784:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120793.282498:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:10158:x1876028901318784:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 313us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120793.282508:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 299 00000100:00100000:3.0:1789120793.286449:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120793.286585:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901318912 00000100:00100000:0.0:1789120793.286599:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901318912 00000100:00100000:0.0:1789120793.286671:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 300 00000100:00100000:0.0:1789120793.286683:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:10158:x1876028901318912:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120793.287364:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:10158:x1876028901318912:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 679us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120793.287376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 300 00010000:00010000:0.0:1789120793.835696:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120794.091627:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789120794.858780:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120794.858811:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922326016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120794.858904:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120794.859185:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326016 00000100:00100000:1.0:1789120794.859195:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326016 00000100:00100000:1.0:1789120794.859260:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120794.859284:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922326016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120794.859329:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120794.859381:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5486d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922326016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120794.859389:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789120794.859429:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120794.859472:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922326016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789120794.860997:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120795.883197:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120796.394722:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922326144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120796.394821:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120796.394886:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922326272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120796.394928:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120796.394976:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326144 00000100:00100000:0.0:1789120796.395020:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326272 00000100:00100000:0.0:1789120796.395029:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326272 00000100:00100000:1.0:1789120796.395131:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326144 00000100:00100000:1.0:1789120796.395203:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120796.395215:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922326144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120796.395260:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120796.395308:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922326144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.395337:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120796.395369:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922326400:0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395405:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120796.395429:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120796.395434:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922326528:0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395512:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120796.395541:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120796.395556:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326400 00000100:00100000:1.0:1789120796.395560:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326400 00000100:00100000:1.0:1789120796.395589:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326528 00000100:00100000:1.0:1789120796.395592:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326528 00000100:00100000:1.0:1789120796.395618:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789120796.395624:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395665:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922326400:12345-0@lo:400:kworker.0 Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.395672:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789120796.395685:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120796.395692:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922326528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395720:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922326528:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.395726:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789120796.395744:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120796.395772:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922326528:0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395783:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922326400:0@lo:400:kworker.0 00000100:00100000:1.0:1789120796.395831:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789120796.395847:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922326272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120796.395918:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922326656:0@lo:400:kworker.0 00000100:00100000:0.0:1789120796.395956:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789120796.395989:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdc1c09a40 x1876028922326144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120796.396007:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922326144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120796.396077:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326656 00000100:00100000:0.0:1789120796.396081:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326656 00000100:00100000:0.0:1789120796.396120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789120796.396128:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922326656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120796.396178:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922326656:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120796.396185:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789120796.396211:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922326656:0@lo:400:kworker.0 00000100:00080000:0.0:1789120796.396228:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120796.401307:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120796.401347:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922326784:0@lo:400:kworker.0 00000100:00100000:0.0:1789120796.401793:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120796.401918:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326784 00000100:00100000:1.0:1789120796.401918:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922326272:12345-0@lo:400:kworker.0 Request processed in 6068us (6985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120796.401929:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326784 00000100:00100000:1.0:1789120796.401931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789120796.401993:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120796.402003:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922326784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120796.402075:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922326272:0@lo:400:kworker.0 00000100:00100000:2.0:1789120796.402097:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922326784:12345-0@lo:400:kworker.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.402174:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922326784:0@lo:400:kworker.0 00000100:00100000:2.0:1789120796.402246:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1789120796.402307:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789120796.906662:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789120796.996367:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1789120797.107471:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120797.107528:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120797.107575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120797.107679:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120797.107870:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319168 00000100:00100000:1.0:1789120797.107881:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319168 00000100:00100000:1.0:1789120797.107953:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319424 00000100:00100000:1.0:1789120797.107956:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319424 00000100:00100000:1.0:1789120797.107978:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:1.0:1789120797.107988:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319168:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120797.108092:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319168:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 105us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120797.108100:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:1.0:1789120797.108121:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:1.0:1789120797.108127:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901319424:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120797.108205:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901319424:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120797.108212:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:0.0:1789120797.108714:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319296 00000100:00100000:0.0:1789120797.108720:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319296 00000100:00100000:0.0:1789120797.108774:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:0.0:1789120797.108782:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319296:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120797.108821:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319296:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 41us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120797.108828:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00080000:3.0:1789120797.109108:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120797.109115:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120797.115959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319040 00000100:00100000:2.0:1789120797.115977:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319040 00000100:00100000:2.0:1789120797.116127:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 302 00000100:00100000:2.0:1789120797.116161:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901319040:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120797.116260:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901319040:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 117us (8683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120797.116268:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 302 00010000:00010000:0.0:1789120797.930927:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120798.955349:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120799.979010:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120799.979051:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922326912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789120799.979100:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120799.979195:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120799.979252:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922326912 00000100:00100000:1.0:1789120799.979261:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922326912 00000100:00080000:3.0:1789120799.979313:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120799.979514:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120799.979527:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922326912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120799.979583:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120799.979656:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922326912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120799.979665:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789120799.980246:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789120799.980257:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdafcc5a40, transno 4294967300 00000100:00100000:2.0:1789120799.980280:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922326912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789120801.002736:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120801.516315:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922327424:0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.516349:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922327168:0@lo:400:kworker.0 00000100:00100000:3.0:1789120801.516520:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922327040:0@lo:400:kworker.0 00000100:00100000:2.0:1789120801.516899:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922327296:0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.522376:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120801.522473:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922327680:0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.522562:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120801.522635:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327168 00000100:00100000:0.0:1789120801.522644:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327168 00000100:00100000:0.0:1789120801.522703:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789120801.522714:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922327168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.522781:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922327168:12345-0@lo:400:kworker.0 Request processed in 68us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120801.522788:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789120801.522817:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327680 00000100:00100000:0.0:1789120801.522821:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327680 00000100:00100000:0.0:1789120801.522862:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120801.522868:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922327680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.522902:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922327680:12345-0@lo:400:kworker.0 Request processed in 34us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120801.522908:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120801.522993:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922327168:0@lo:400:kworker.0 00010000:00080000:0.0:1789120801.523009:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc61c0 x1876028922327680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120801.523032:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922327680:0@lo:400:kworker.0 00000100:00100000:1.0:1789120801.528407:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120801.528495:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327424 00000100:00100000:0.0:1789120801.528507:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327424 00000100:00100000:0.0:1789120801.528588:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120801.528602:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922327424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.528689:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922327424:12345-0@lo:400:kworker.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120801.528696:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789120801.528754:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922327424:0@lo:400:kworker.0 00000100:00100000:2.0:1789120801.533336:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120801.533437:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922327808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120801.533492:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120801.533711:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327808 00000100:00100000:0.0:1789120801.533720:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327808 00000100:00100000:0.0:1789120801.533781:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120801.533792:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922327808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120801.533840:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120801.534108:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327296 00000100:00100000:1.0:1789120801.534113:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327296 00000100:00100000:1.0:1789120801.534181:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789120801.534190:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922327296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120801.535487:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120801.535568:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922327552:0@lo:400:kworker.0 00000100:00100000:3.0:1789120801.535613:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789120801.535658:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120801.535664:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120801.535667:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120801.535680:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327552 00000100:00100000:3.0:1789120801.535686:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327552 00000100:00100000:3.0:1789120801.535762:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789120801.535771:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922327552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120801.535822:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922327552:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120801.535831:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789120801.535855:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120801.535888:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922327552:0@lo:400:kworker.0 00000100:00100000:1.0:1789120801.540777:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922327296:12345-0@lo:400:kworker.0 Request processed in 6574us (7437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120801.540796:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789120801.540869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327040 00000100:00100000:1.0:1789120801.540880:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327040 00000100:00100000:1.0:1789120801.540934:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789120801.540943:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922327040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120801.541051:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922327040:12345-0@lo:400:kworker.0 Request processed in 108us (5572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120801.541058:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789120801.541984:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922327040:0@lo:400:kworker.0 00000100:00100000:3.0:1789120801.543083:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922327296:0@lo:400:kworker.0 00000100:00100000:0.0:1789120801.543191:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922327808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9396us (9694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120801.543203:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789120801.544377:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc52c0 x1876028922327808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120801.544407:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922327808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789120802.029249:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120802.224884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120802.224929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120802.225893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120802.225936:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319552 00000100:00100000:1.0:1789120802.225946:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319552 00000100:00100000:0.0:1789120802.226338:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319680 00000100:00100000:0.0:1789120802.226352:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319680 00000100:00080000:3.0:1789120802.226412:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120802.226419:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 304 00000100:00100000:1.0:1789120802.226436:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901319552:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120802.226449:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:0.0:1789120802.226463:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319680:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120802.226582:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901319680:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 119us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.226594:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:1.0:1789120802.226712:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901319552:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 277us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.226723:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 304 00000100:00100000:0.0:1789120802.226836:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319808 00000100:00100000:0.0:1789120802.226844:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319808 00000100:00100000:0.0:1789120802.226905:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:0.0:1789120802.226919:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901319808:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120802.226982:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901319808:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 67us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.226990:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00080000:3.0:1789120802.227131:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120802.231509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120802.231556:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901319936 00000100:00100000:1.0:1789120802.231566:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901319936 00000100:00100000:1.0:1789120802.231765:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00100000:1.0:1789120802.231777:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901319936:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120802.231862:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901319936:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.231870:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00080000:1.0:1789120802.231897:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789120803.050466:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120804.074666:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120804.331701:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789120805.098482:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922327936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120805.098558:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120805.098691:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120805.098771:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922327936 00000100:00100000:2.0:1789120805.098779:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922327936 00000100:00100000:2.0:1789120805.098838:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120805.098847:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922327936:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789120805.098865:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789120805.098897:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120805.099022:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922327936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120805.099030:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120805.099328:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922327936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789120806.123049:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120806.634415:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922328064:0@lo:400:kworker.0 00000100:00100000:0.0:1789120806.634497:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922328192:0@lo:400:kworker.0 00000100:00100000:3.0:1789120806.634512:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120806.634555:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120806.634694:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328064 00000100:00100000:2.0:1789120806.634700:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328064 00000100:00100000:2.0:1789120806.634746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789120806.634756:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.634802:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922328064:12345-0@lo:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120806.634809:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789120806.634856:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922328064:0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.634872:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120806.634878:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922328448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120806.634917:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120806.634946:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328448 00000100:00100000:2.0:1789120806.634950:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328448 00000100:00100000:2.0:1789120806.635010:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789120806.635017:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922328448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120806.635046:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120806.635081:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922328448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120806.635088:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789120806.635104:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789120806.635137:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc5680 x1876028922328448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120806.635170:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922328448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120806.635196:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922328320:0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.635222:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120806.635256:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328320 00000100:00100000:2.0:1789120806.635260:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328320 00000100:00100000:2.0:1789120806.635305:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789120806.635312:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922328320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.635347:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922328320:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120806.635353:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789120806.635370:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120806.635386:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922328320:0@lo:400:kworker.0 00000100:00100000:3.0:1789120806.635703:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328192 00000100:00100000:3.0:1789120806.635709:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328192 00000100:00100000:3.0:1789120806.635751:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789120806.635759:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922328192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.636761:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922328576:0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.636808:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120806.636893:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328576 00000100:00100000:1.0:1789120806.636898:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328576 00000100:00100000:1.0:1789120806.636936:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120806.636944:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922328576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120806.637428:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922328576:12345-0@lo:400:kworker.0 Request processed in 482us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120806.637436:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120806.637464:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120806.637473:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922328704:0@lo:400:kworker.0 00000100:00100000:1.0:1789120806.637502:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120806.637531:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328704 00000100:00100000:1.0:1789120806.637548:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328704 00000100:00100000:1.0:1789120806.637599:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789120806.637607:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922328704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120806.637648:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922328704:12345-0@lo:400:kworker.0 Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120806.637654:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789120806.637673:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120806.637697:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922328704:0@lo:400:kworker.0 00000100:00100000:2.0:1789120806.637835:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922328576:0@lo:400:kworker.0 00000100:00100000:3.0:1789120806.638190:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922328192:12345-0@lo:400:kworker.0 Request processed in 2428us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120806.638199:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789120806.638430:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922328192:0@lo:400:kworker.0 00010000:00010000:0.0:1789120807.146908:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120807.345796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120807.345844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120807.345930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320064 00000100:00100000:2.0:1789120807.345953:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320064 00000100:00100000:2.0:1789120807.346018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 306 00000100:00100000:2.0:1789120807.346027:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901320064:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120807.346094:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901320064:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120807.346101:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 306 00000100:00100000:3.0:1789120807.346602:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320192 00000100:00100000:3.0:1789120807.346609:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320192 00000100:00100000:3.0:1789120807.346665:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:3.0:1789120807.346682:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901320192:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120807.346731:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901320192:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 52us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120807.346738:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00080000:1.0:1789120807.346865:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120807.354236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120807.354282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120807.354446:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320320 00000100:00100000:0.0:1789120807.354457:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320320 00000100:00100000:0.0:1789120807.354542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789120807.354552:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2348:x1876028901320320:12345-192.168.206.9@tcp:9:kworker.0 00000020:00000080:0.0:1789120807.354582:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4f29 00000100:00080000:0.0:1789120807.354591:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d39b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789120807.354628:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789120807.354873:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+2:2348:x1876028901320320:12345-192.168.206.9@tcp:9:kworker.0 Request processed in 321us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.354882:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00010000:00010000:0.0:1789120807.354902:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120807.355343:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120807.355452:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320448 00000100:00100000:2.0:1789120807.355458:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320448 00000100:00100000:2.0:1789120807.355519:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:2.0:1789120807.355531:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901320448:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120807.355584:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901320448:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 56us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120807.355592:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00080000:1.0:1789120807.355767:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120808.170850:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120809.194539:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120810.218425:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922328832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120810.218493:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120810.218515:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328832 00000100:00100000:2.0:1789120810.218523:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328832 00000100:00080000:1.0:1789120810.218564:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120810.218579:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789120810.218584:0:6709:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789120810.218587:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922328832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120810.218591:0:6709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789120810.218619:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120810.218679:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922328832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120810.218687:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789120810.218920:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922328832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789120810.219056:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120811.243007:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120811.754806:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922328960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120811.754878:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120811.755560:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922328960 00000100:00100000:0.0:1789120811.755568:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922328960 00000100:00100000:0.0:1789120811.755639:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120811.755648:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922328960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120811.755696:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120811.755749:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922328960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120811.755757:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789120811.756010:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc5a40 x1876028922328960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120811.756031:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922328960:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789120811.756602:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120811.756788:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922329344:0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.756834:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120811.756869:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120811.756886:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922329216:0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.756909:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120811.756946:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922329472:0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.756981:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120811.757000:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789120811.757005:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922329088:0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.757031:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120811.757057:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922329600:0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.757077:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120811.757102:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329472 00000100:00100000:1.0:1789120811.757106:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329472 00000100:00100000:1.0:1789120811.757140:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789120811.757172:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922329472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120811.757215:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922329472:12345-0@lo:400:kworker.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120811.757222:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789120811.757259:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922329472:0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757544:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329344 00000100:00100000:2.0:1789120811.757549:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329344 00000100:00100000:2.0:1789120811.757596:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329216 00000100:00100000:2.0:1789120811.757599:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329216 00000100:00100000:2.0:1789120811.757611:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329600 00000100:00100000:2.0:1789120811.757613:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329600 00000100:00100000:2.0:1789120811.757641:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789120811.757647:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922329344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757694:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922329344:12345-0@lo:400:kworker.0 Request processed in 47us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120811.757699:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789120811.757712:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789120811.757718:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922329216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757742:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922329216:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120811.757747:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789120811.757758:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789120811.757764:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922329600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757794:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922329600:12345-0@lo:400:kworker.0 Request processed in 31us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120811.757799:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789120811.757818:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329088 00000100:00100000:2.0:1789120811.757821:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329088 00000100:00100000:2.0:1789120811.757843:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789120811.757848:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922329088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757877:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd873de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922329088:12345-0@lo:400:kworker.0 Request processed in 29us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120811.757883:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789120811.757932:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922329088:0@lo:400:kworker.0 00000100:00100000:2.0:1789120811.757942:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922329600:0@lo:400:kworker.0 00000100:00100000:0.0:1789120811.758114:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922329216:0@lo:400:kworker.0 00000100:00100000:0.0:1789120811.758125:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922329344:0@lo:400:kworker.0 00000100:00080000:1.0:1789120811.761188:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120812.269353:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789120812.348302:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:2.0:1789120812.348323:0:6729:0:(genops.c:885:class_export_put()) final put ffff9ffd9d399800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:2.0:1789120812.348595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd9d399800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-OST0000 00000020:00000080:2.0:1789120812.348646:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd9d39b000 for lustre-OST0000 00000100:00100000:1.0:1789120812.465853:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120812.465890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120812.465921:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320704 00000100:00100000:2.0:1789120812.465930:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320704 00000100:00100000:3.0:1789120812.465992:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320576 00000100:00080000:1.0:1789120812.465994:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120812.465999:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320576 00000100:00100000:2.0:1789120812.466008:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:2.0:1789120812.466021:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901320704:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120812.466050:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 308 00000100:00100000:3.0:1789120812.466060:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901320576:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120812.466109:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901320704:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120812.466116:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:3.0:1789120812.468198:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901320576:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 2131us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120812.468211:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 308 00000100:00100000:1.0:1789120812.468586:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120812.470942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320832 00000100:00100000:3.0:1789120812.470967:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320832 00000100:00100000:3.0:1789120812.471073:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789120812.471083:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901320832:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120812.471635:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901320832:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 552us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120812.471644:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00080000:1.0:1789120812.471826:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120813.290559:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120814.314777:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120814.572074:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789120815.340621:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120815.340650:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922329728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120815.340737:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120815.340815:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120815.340830:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329728 00000100:00100000:2.0:1789120815.340837:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329728 00000100:00100000:2.0:1789120815.340912:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789120815.340923:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922329728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120815.340979:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120815.341029:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922329728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120815.341036:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789120815.341060:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120815.341098:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922329728:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789120815.858750:0:12251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:00:13 (1789120813) 00010000:00010000:3.0:1789120816.362886:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120816.874524:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922330240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.874558:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922329856:0@lo:400:kworker.0 00000100:00100000:2.0:1789120816.875385:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922330112:0@lo:400:kworker.0 00000100:00100000:3.0:1789120816.875512:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922329984:0@lo:400:kworker.0 00000100:00100000:1.0:1789120816.876360:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120816.876497:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922330240 00000100:00100000:1.0:1789120816.876506:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922330240 00000100:00100000:1.0:1789120816.876565:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789120816.876577:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922330240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120816.876645:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922330240:12345-0@lo:400:kworker.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.876653:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789120816.876707:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922330240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.878358:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120816.878426:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922330368:0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.878496:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120816.878566:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922330368 00000100:00100000:0.0:1789120816.878574:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922330368 00000100:00100000:0.0:1789120816.878631:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789120816.878640:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922330368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.878692:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922330368:12345-0@lo:400:kworker.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.878700:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789120816.878720:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120816.878749:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922330368:0@lo:400:kworker.0 00000100:00100000:1.0:1789120816.879220:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329856 00000100:00100000:1.0:1789120816.879227:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329856 00000100:00100000:1.0:1789120816.879272:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789120816.879280:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922329856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120816.879328:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922329856:12345-0@lo:400:kworker.0 Request processed in 49us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.879335:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789120816.879470:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922329856:0@lo:400:kworker.0 00000100:00100000:2.0:1789120816.879856:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120816.879890:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120816.879921:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120816.880164:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922330624 00000100:00100000:1.0:1789120816.880179:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922330624 00000100:00100000:1.0:1789120816.880236:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789120816.880244:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922330624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120816.880282:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120816.880327:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922330624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.880335:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789120816.880377:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb99cde00 x1876028922330624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120816.880412:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120816.880783:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922330112 00000100:00100000:0.0:1789120816.880789:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922330112 00000100:00100000:0.0:1789120816.880839:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789120816.881289:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120816.881302:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120816.881336:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922330496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.881371:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922330112:12345-0@lo:400:kworker.0 Request processed in 76us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.881379:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789120816.881385:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120816.881400:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922329984 00000100:00100000:0.0:1789120816.881406:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922329984 00000100:00100000:3.0:1789120816.881435:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922330496 00000100:00100000:3.0:1789120816.881440:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922330496 00000100:00100000:3.0:1789120816.881475:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789120816.881483:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922330496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120816.881522:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922330496:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120816.881529:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789120816.881566:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdafcc7840 x1876028922330496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120816.881652:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922330496:0@lo:400:kworker.0 00000100:00080000:2.0:1789120816.881704:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120816.881711:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120816.881773:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922330112:0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.881948:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789120816.881958:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922329984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120816.882010:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922329984:12345-0@lo:400:kworker.0 Request processed in 54us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.882016:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789120816.882355:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922329984:0@lo:400:kworker.0 00010000:00010000:0.0:1789120817.387950:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120817.396472:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120817.397166:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901320960 00000100:00100000:0.0:1789120817.397182:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901320960 00000100:00100000:0.0:1789120817.397281:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789120817.397294:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:10424:x1876028901320960:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120817.397322:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120817.397353:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa4ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad74 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.397442:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.397460:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.397777:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120817.400523:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789120817.400539:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120817.400738:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.400795:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa4ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad74 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.400829:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad74 expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.400840:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd9fd7cb00) 00010000:00010000:0.0:1789120817.400844:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120817.400848:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a000, rc 0) 00000100:00100000:0.0:1789120817.400958:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:10424:x1876028901320960:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3666us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.400969:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00080000:2.0:1789120817.401212:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120817.410844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120817.410952:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321088 00000100:00100000:0.0:1789120817.410967:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321088 00000100:00100000:0.0:1789120817.411036:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:0.0:1789120817.411047:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:10425:x1876028901321088:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120817.411074:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120817.411099:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa5002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad7b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411212:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411229:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411242:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411258:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411285:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411293:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411772:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411784:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.411792:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120817.411882:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789120817.411887:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120817.411988:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412001:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412008:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412016:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412023:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120817.412032:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412047:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412062:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd9fd7cb00) 00010000:00010000:0.0:1789120817.412065:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120817.412072:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412078:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412093:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412099:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412105:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412109:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120817.412112:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412117:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412124:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120817.412126:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120817.412129:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412201:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5010 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412246:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa5002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad7b expref: 8 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412261:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad7b expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120817.412268:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7ca00) 00010000:00010000:0.0:1789120817.412271:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120817.412273:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a400, rc 0) 00000100:00100000:0.0:1789120817.412355:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:10425:x1876028901321088:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1309us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.412365:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:1.0:1789120817.415563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120817.420267:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321344 00000100:00100000:3.0:1789120817.420287:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321344 00000100:00100000:3.0:1789120817.420380:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:3.0:1789120817.420393:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:10425:x1876028901321344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120817.420422:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120817.420449:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa501e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad82 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420576:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420595:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420608:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420757:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420780:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.420794:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421391:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa5033 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421404:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa5033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421412:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa5033 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120817.421424:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789120817.421629:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421638:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421653:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421660:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120817.421664:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421672:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421686:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7ca00) 00010000:00010000:3.0:1789120817.421689:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120817.421694:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421701:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421715:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421723:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421731:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421738:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120817.421742:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421760:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421769:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffd831cf300) 00010000:00010000:3.0:1789120817.421772:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120817.421775:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.421781:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa502c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.422240:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa501e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad82 expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.422258:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa5033 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad82 expref: 9 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120817.422267:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:3.0:1789120817.422269:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120817.422272:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390bc00, rc 0) 00000100:00100000:3.0:1789120817.422338:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10425:x1876028901321344:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1948us (6789us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789120817.422349:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789120817.430331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120817.433988:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321472 00000100:00100000:3.0:1789120817.434008:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321472 00000100:00100000:3.0:1789120817.434546:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:3.0:1789120817.434565:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10425:x1876028901321472:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789120817.434808:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10425:x1876028901321472:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 249us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120817.434817:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:2.0:1789120817.584123:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120817.584197:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120817.584218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120817.584305:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321856 00000100:00100000:0.0:1789120817.584316:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321856 00000100:00100000:0.0:1789120817.584384:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321728 00000100:00100000:0.0:1789120817.584387:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321728 00000100:00100000:0.0:1789120817.584409:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:0.0:1789120817.584418:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901321856:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120817.584506:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+5:2352:x1876028901321856:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.584514:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:0.0:1789120817.584531:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:0.0:1789120817.584538:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2352:x1876028901321728:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120817.584828:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2352:x1876028901321728:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 288us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.584835:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00080000:2.0:1789120817.585543:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120817.585807:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321600 00000100:00100000:3.0:1789120817.585815:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321600 00000100:00100000:3.0:1789120817.585859:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 310 00000100:00100000:3.0:1789120817.585868:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901321600:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120817.585932:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901321600:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 56us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120817.585940:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 310 00000040:00080000:0.0:1789120817.643098:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789120818.416933:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120819.130698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120819.130835:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901321984 00000100:00100000:0.0:1789120819.130845:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901321984 00000100:00100000:0.0:1789120819.130933:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:0.0:1789120819.130946:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10467:x1876028901321984:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120819.130967:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120819.130989:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad89 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131049:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131063:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131076:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131091:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131098:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131104:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131416:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131426:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131433:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131440:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.131444:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131451:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131463:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd9fd7cb00) 00010000:00010000:0.0:1789120819.131466:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.131470:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131476:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131487:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131494:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131500:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131511:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.131514:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131520:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131528:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120819.131530:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.131533:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131539:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa504f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131569:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5041 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad89 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131578:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd9fd7cb00) 00010000:00010000:0.0:1789120819.131580:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.131584:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad89 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.131605:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120819.131667:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10467:x1876028901321984:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 725us (977us total) trans 0 rc 301/301 00000100:00100000:0.0:1789120819.131675:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00080000:2.0:1789120819.132738:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120819.138615:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.138668:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901322240 00000100:00100000:3.0:1789120819.138682:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901322240 00000100:00100000:3.0:1789120819.138759:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:3.0:1789120819.138772:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10467:x1876028901322240:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:3.0:1789120819.138852:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120819.138887:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa4ffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad74 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.138910:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd9fd7cb00) 00010000:00010000:3.0:1789120819.138935:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120819.139338:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.139354:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.139380:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.139394:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.139401:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.139408:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120819.140492:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789120819.140510:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140520:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140527:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140533:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.140538:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140546:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140561:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cff00) 00010000:00010000:3.0:1789120819.140565:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120819.140579:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.140587:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5056 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120819.140610:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004bf481d9 reply state 0000000043bf348b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.140620:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120819.140773:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:10467:x1876028901322240:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 2000us (2168us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789120819.140784:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00010000:00010000:0.0:1789120819.150690:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150716:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150722:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150728:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.150732:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150739:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150756:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffd831cfc00) 00010000:00010000:0.0:1789120819.150759:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.150763:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.150769:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa505d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.202208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.202310:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901322368 00000100:00100000:1.0:1789120819.202318:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901322368 00000100:00100000:1.0:1789120819.202373:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:1.0:1789120819.202384:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10475:x1876028901322368:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:1.0:1789120819.202419:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120819.202442:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad90 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202508:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202523:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202533:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120819.202590:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789120819.202595:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120819.202639:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202662:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad90 expref: 11 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202686:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad90 expref: 10 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.202694:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:1.0:1789120819.202697:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120819.202700:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bac00, rc 0) 00000100:00100000:1.0:1789120819.202749:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:10475:x1876028901322368:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 367us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120819.202756:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789120819.266671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120819.266768:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901322496 00000100:00100000:0.0:1789120819.266778:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901322496 00000100:00100000:0.0:1789120819.266838:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789120819.266847:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:10481:x1876028901322496:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120819.266865:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120819.266884:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad97 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269468:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269491:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269504:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269522:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269530:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269537:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269799:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269807:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269815:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120819.269848:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789120819.269852:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120819.269973:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.269997:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270003:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270082:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270089:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.270092:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270099:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270111:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:0.0:1789120819.270114:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.270119:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270125:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270136:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270179:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270184:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270195:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.270198:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270205:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270213:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120819.270215:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.270218:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270224:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270260:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad97 expref: 12 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270694:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad97 expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.270702:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120819.270704:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789120819.270707:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a200, rc 0) 00000100:00100000:0.0:1789120819.270821:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:10481:x1876028901322496:12345-192.168.206.9@tcp:101:bash.0 Request processed in 3974us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120819.270830:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789120819.275453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.275579:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901322752 00000100:00100000:3.0:1789120819.275597:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901322752 00000100:00100000:3.0:1789120819.275692:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789120819.275705:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:10481:x1876028901322752:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120819.275735:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120819.276866:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa508e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ad9e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277322:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277340:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277355:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277535:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277558:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.277570:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120819.278366:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789120819.278561:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278572:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278580:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278615:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278622:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278628:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278634:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.278639:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278657:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278670:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120819.278674:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120819.278679:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278686:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5095 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120819.278698:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000054aa61c0 reply state 00000000bd377803 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.278707:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789120819.278746:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa508e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278762:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.278768:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120819.278770:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120819.278772:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120819.278844:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10481:x1876028901322752:12345-192.168.206.9@tcp:101:bash.0 Request processed in 3142us (3397us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789120819.278854:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00010000:00010000:0.0:1789120819.283432:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283452:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283460:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283467:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120819.283473:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283481:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283497:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cff00) 00010000:00010000:0.0:1789120819.283500:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120819.283504:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.283509:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa509c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120819.285587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.285805:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901322880 00000100:00100000:2.0:1789120819.285824:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901322880 00000100:00100000:2.0:1789120819.285885:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:2.0:1789120819.285898:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901322880:12345-192.168.206.9@tcp:8:bash.0 00010000:00080000:2.0:1789120819.285953:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:2.0:1789120819.285998:0:6707:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa50b1 00002000:00100000:2.0:1789120819.286012:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76510092-6f58-4075-a7f3-7af5ca8b7da2/ffff9ffdb990c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789120819.286053:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789120819.286550:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789120819.286590:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120819.286688:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901322880:12345-192.168.206.9@tcp:8:bash.0 Request processed in 790us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120819.286697:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120819.289610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.289963:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901323008 00000100:00100000:1.0:1789120819.289973:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901323008 00000100:00100000:1.0:1789120819.290062:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:1.0:1789120819.290072:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:0:x1876028901323008:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120819.290090:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120819.290110:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ada5 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120819.290135:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:2.0:1789120819.290172:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789120819.290195:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1789120819.290203:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120819.290213:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.290234:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.290266:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb400, rc 0) 00000100:00100000:1.0:1789120819.290321:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:0:x1876028901323008:12345-192.168.206.9@tcp:101:bash.0 Request processed in 251us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120819.290329:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789120819.295101:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.295564:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901323136 00000100:00100000:1.0:1789120819.295574:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901323136 00000100:00100000:1.0:1789120819.295629:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:1.0:1789120819.295639:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:10481:x1876028901323136:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120819.295657:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120819.295677:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adac expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.295895:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.295928:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120819.295932:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120819.295938:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.295974:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.295988:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 8 pid: 8216 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.296002:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1876028922330752:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120819.296090:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120819.299624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.300776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901323264 00000100:00100000:1.0:1789120819.300786:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901323264 00010000:00010000:1.0:1789120819.300833:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 9 pid: 8216 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120819.300866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:1.0:1789120819.300876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901323264:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120819.300889:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120819.300921:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 9 pid: 8216 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.300936:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 9 pid: 8216 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.300974:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120819.300979:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120819.300987:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.300997:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.301033:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120819.301113:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd954f70c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1876028922330880:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789120819.301215:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99180 going to sleep for 11 seconds 00010000:00010000:3.0:1789120819.303328:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb8e6f66/0x13cfa3d77faa50b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ada5 expref: 9 pid: 8216 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.303426:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1876028922330752:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120819.303456:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.303541:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:3.0:1789120819.303647:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:10481:x1876028901323136:12345-192.168.206.9@tcp:101:bash.0 Request processed in 7954us (8498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.303671:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:0.0:1789120819.316899:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd954f70c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1876028922330880:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789120819.316947:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120819.317016:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901323264:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 16140us (17399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120819.317050:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:0.0:1789120819.323109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.323266:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901323520 00000100:00100000:3.0:1789120819.323278:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901323520 00000100:00100000:3.0:1789120819.323351:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:3.0:1789120819.323364:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10481:x1876028901323520:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:3.0:1789120819.323795:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10481:x1876028901323520:12345-192.168.206.9@tcp:35:bash.0 Request processed in 433us (699us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789120819.323805:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00010000:00010000:3.0:1789120819.434762:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120819.439885:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.440062:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901323776 00000100:00100000:3.0:1789120819.440074:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901323776 00000100:00100000:3.0:1789120819.440197:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789120819.440209:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10491:x1876028901323776:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120819.440239:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120819.440264:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adb3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120819.440411:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789120819.440547:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adb3 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.440565:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:3.0:1789120819.440568:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120819.440574:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adb3 expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.440612:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a400, rc 0) 00000100:00100000:3.0:1789120819.440755:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10491:x1876028901323776:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 548us (885us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789120819.440764:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:0.0:1789120819.442939:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.443040:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324032 00000100:00100000:3.0:1789120819.443053:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324032 00000100:00100000:3.0:1789120819.443205:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789120819.443217:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10491:x1876028901324032:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120819.443538:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:10491:x1876028901324032:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 322us (621us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789120819.443546:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789120819.579115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120819.583659:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324160 00000100:00100000:0.0:1789120819.583679:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324160 00000100:00100000:0.0:1789120819.583854:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:0.0:1789120819.583868:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:10497:x1876028901324160:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120819.583918:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120819.583946:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa50d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adba expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584035:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584052:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584065:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120819.584141:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789120819.584168:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120819.584202:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584232:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa50d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adba expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584255:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adba expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.584282:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120819.584286:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120819.584305:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4be00, rc 0) 00000100:00100000:0.0:1789120819.584404:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:10497:x1876028901324160:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 539us (5303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120819.584412:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:0.0:1789120819.594697:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.594832:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324416 00000100:00100000:3.0:1789120819.594844:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324416 00000100:00100000:3.0:1789120819.594938:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:3.0:1789120819.594950:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:10497:x1876028901324416:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120819.594978:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120819.595005:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adc1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.595128:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa50e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.595186:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa50e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.595202:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa50e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120819.595233:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789120819.595390:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc1 expref: 20 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.595412:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa50e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc1 expref: 19 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.595422:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120819.595425:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120819.595430:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:3.0:1789120819.595720:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:10497:x1876028901324416:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 771us (1037us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789120819.595729:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:1.0:1789120819.615672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.615727:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.615832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324800 00000100:00100000:2.0:1789120819.615846:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324800 00000100:00100000:2.0:1789120819.615946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789120819.615959:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:2349:x1876028901324800:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120819.615981:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120819.616018:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa50e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc1 expref: 19 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.616045:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:2.0:1789120819.616052:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120819.616133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:2349:x1876028901324800:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 177us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120819.616198:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:3.0:1789120819.616709:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324672 00000100:00100000:3.0:1789120819.616716:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324672 00000100:00100000:3.0:1789120819.616766:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789120819.616776:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10497:x1876028901324672:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120819.616805:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120819.616827:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adc8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.616965:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.616983:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.617020:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120819.617047:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789120819.617252:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa50f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc8 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.617273:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc8 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.617281:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120819.617284:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789120819.617288:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a600, rc 0) 00000100:00100000:2.0:1789120819.617387:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:10497:x1876028901324672:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 612us (1729us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789120819.617395:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:1.0:1789120819.627048:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.627279:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901324928 00000100:00100000:3.0:1789120819.627293:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901324928 00000100:00100000:3.0:1789120819.627367:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:3.0:1789120819.627380:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901324928:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:3.0:1789120819.627475:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.627506:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.627515:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120819.627520:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120819.627525:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.627579:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.627596:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 7 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.627613:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922331008:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120819.627744:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120819.637254:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922331008:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120819.637297:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120819.637902:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.638429:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325056 00000100:00100000:3.0:1789120819.638439:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325056 00002000:00100000:3.0:1789120819.638489:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ffdb5faa940 x1876028901325056/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:350/0 lens 504/0 e 0 to 0 dl 1789120830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789120819.638500:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb5faa940 with x1876028901325056 ext(0->12) 00010000:00010000:3.0:1789120819.638509:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 8 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.638524:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 8 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120819.638532:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdb5faa940 00000100:00100000:3.0:1789120819.638638:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:3.0:1789120819.638660:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901325056:12345-192.168.206.9@tcp:4:lfs.0 00000001:00100000:0.0:1789120819.694822:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000100:00100000:0.0:1789120819.695595:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901325056:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 56933us (57698us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789120819.695758:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00002000:00100000:0.0:1789120819.695775:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ffdb5faa940 x1876028901325056/t4294967299(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:350/0 lens 504/448 e 0 to 0 dl 1789120830 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120819.695785:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb5faa940 with x1876028901325056 ext(0->12) 00010000:00010000:0.0:1789120819.695796:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.695813:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120819.695821:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdb5faa940 00000100:00100000:0.0:1789120819.698784:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120819.699025:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325184 00000100:00100000:1.0:1789120819.699034:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325184 00010000:00010000:1.0:1789120819.699073:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120819.699120:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:1.0:1789120819.699130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901325184:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120819.699221:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789120819.699251:0:5843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789120819.699254:0:5843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789120819 00002000:00010000:1.0:1789120819.699257:0:5843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789120819 00002000:00010000:1.0:1789120819.699259:0:5843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789120819 00010000:00010000:1.0:1789120819.699265:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.699279:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.699303:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa50bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adac expref: 9 pid: 6705 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.699319:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120819.699323:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120819.699328:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.699338:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120819.699369:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120819.699408:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699418:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699441:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699449:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699457:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699464:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120819.699468:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699477:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699493:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.699511:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042e47491/0x13cfa3d77faa510c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120819.699903:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901325184:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 772us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120819.699922:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789120819.701376:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901324928:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 73992us (74348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.701388:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:3.0:1789120819.703786:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.703991:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325440 00000100:00100000:2.0:1789120819.704004:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325440 00000100:00100000:2.0:1789120819.704135:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789120819.704183:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:10497:x1876028901325440:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:2.0:1789120819.704270:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc8 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120819.705389:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789120819.705614:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789120819.707981:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789120819.708340:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.708369:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.708380:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.708555:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.708574:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 24 pid: 5858 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120819.708592:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922331136:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120819.708794:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120819.714979:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.715128:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922331136:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120819.715253:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.715363:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325568 00000100:00100000:3.0:1789120819.715372:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325568 00010000:00010000:3.0:1789120819.715417:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 25 pid: 5858 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.715474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:3.0:1789120819.715486:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:2350:x1876028901325568:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120819.715799:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120819.715810:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 25 pid: 5858 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715826:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 25 pid: 5858 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715853:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa50a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad9e expref: 25 pid: 5858 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715872:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120819.715893:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715904:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715924:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.715959:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120819.715998:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.716008:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.716101:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:2350:x1876028901325568:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 615us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.716113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000001:00080000:2.0:1789120819.716196:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789120819.716424:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789120819.718249:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922331264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789120819.718342:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120819.718390:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3feccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120819.718856:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922331264 00000100:00100000:1.0:1789120819.718871:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922331264 00000100:00100000:1.0:1789120819.718955:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120819.718980:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922331264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1789120819.719047:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120819.719110:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922331264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120819.719119:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120819.719252:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922331264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789120819.721339:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789120819.721459:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922331392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789120819.721548:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120819.721589:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120819.721977:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922331392 00000100:00100000:0.0:1789120819.721997:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922331392 00000100:00100000:0.0:1789120819.722057:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120819.722068:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922331392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120819.722336:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5860:x1876028922331392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 270us (787us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789120819.722346:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120819.723129:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922331392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789120819.723258:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789120819.723318:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723331:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723339:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723345:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120819.723350:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723359:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723378:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:2.0:1789120819.723381:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789120819.723394:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.723402:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5113 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120819.723636:0:5860:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789120819.724900:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789120819.724936:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286978791631ns, next at 287978787059ns, rc = 0 00000001:00080000:2.0:1789120819.724954:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789120819.725736:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf100) 00010000:00010000:2.0:1789120819.725744:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789120819.725757:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa50fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adc8 expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120819.725955:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10497:x1876028901325440:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 21808us (22183us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789120819.725967:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000020:00080000:2.0:1789120819.725975:0:5860:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789120819.730316:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.730422:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325696 00000100:00100000:3.0:1789120819.730434:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325696 00000100:00100000:3.0:1789120819.730517:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:3.0:1789120819.730528:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10497:x1876028901325696:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120819.730566:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120819.730595:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa511a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adcf expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.730668:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adcf expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.730684:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adcf expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.730705:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120819.730709:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120819.730729:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120819.730802:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:10497:x1876028901325696:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 277us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.730810:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:0.0:1789120819.740373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.740486:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901325952 00000100:00100000:3.0:1789120819.740506:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901325952 00000100:00100000:3.0:1789120819.740578:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120819.740590:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:10497:x1876028901325952:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120819.740892:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:10497:x1876028901325952:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 302us (531us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789120819.740901:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789120819.845431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120819.845545:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901326208 00000100:00100000:0.0:1789120819.845558:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901326208 00000100:00100000:0.0:1789120819.845638:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789120819.845651:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:10508:x1876028901326208:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120819.845685:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120819.845717:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa5121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8add6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120819.845864:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789120819.846036:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa5121 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8add6 expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.846061:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:0.0:1789120819.846064:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789120819.846071:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa5121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8add6 expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120819.846088:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b200, rc 0) 00000100:00100000:0.0:1789120819.846218:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10508:x1876028901326208:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 569us (803us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789120819.846247:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789120819.851196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.851359:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901326336 00000100:00100000:3.0:1789120819.851373:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901326336 00000100:00100000:3.0:1789120819.851442:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789120819.851455:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10508:x1876028901326336:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:3.0:1789120819.851565:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851586:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851603:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851622:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851629:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851666:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851791:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851800:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851807:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120819.851857:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851872:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851878:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851885:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851891:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.851896:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851905:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851931:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120819.851941:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120819.851948:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851955:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa512f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851972:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851978:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851984:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851989:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.851992:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.851998:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852006:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cf800) 00010000:00010000:3.0:1789120819.852008:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120819.852011:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852017:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852034:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852047:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852397:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852404:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.852407:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852414:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852423:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120819.852426:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120819.852429:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.852434:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa513d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.852547:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10508:x1876028901326336:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1092us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.852558:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:1.0:1789120819.856865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.857010:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901326592 00000100:00100000:2.0:1789120819.857023:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901326592 00000100:00100000:2.0:1789120819.857236:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789120819.857254:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10508:x1876028901326592:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120819.858334:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:10508:x1876028901326592:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 1081us (1476us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789120819.858346:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120819.913029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120819.915252:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901326848 00000100:00100000:2.0:1789120819.915271:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901326848 00000100:00100000:2.0:1789120819.915372:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:2.0:1789120819.915404:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:10511:x1876028901326848:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120819.915437:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120819.915465:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8addd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915561:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915578:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915590:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915609:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915616:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.915622:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.917961:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.917987:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.918000:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120819.918037:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789120819.920874:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920895:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920903:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920922:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120819.920927:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920936:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920956:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120819.920959:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120819.920965:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920971:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa514b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920992:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.920998:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921023:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921028:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120819.921030:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921036:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921043:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd84cf3a00) 00010000:00010000:2.0:1789120819.921045:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120819.921049:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921053:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921131:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921407:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120819.921417:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:2.0:1789120819.921419:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120819.921423:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4a00, rc 0) 00000100:00100000:2.0:1789120819.921726:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10511:x1876028901326848:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 6323us (8710us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789120819.921748:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:0.0:1789120819.928540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.928938:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901326976 00000100:00100000:3.0:1789120819.928952:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901326976 00000100:00100000:3.0:1789120819.929198:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789120819.929211:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10511:x1876028901326976:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789120819.929310:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929348:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929363:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929512:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929521:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929529:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929535:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120819.929624:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929635:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929650:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120819.929653:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120819.929659:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120819.929666:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120819.930075:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10511:x1876028901326976:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 863us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.930094:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:1.0:1789120819.935710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120819.935820:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901327232 00000100:00100000:3.0:1789120819.935833:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901327232 00000100:00100000:3.0:1789120819.935919:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789120819.935931:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10511:x1876028901327232:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120819.936258:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:10511:x1876028901327232:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 329us (562us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789120819.936267:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789120820.179474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.181513:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901327488 00000100:00100000:0.0:1789120820.181527:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901327488 00000100:00100000:0.0:1789120820.181665:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:0.0:1789120820.181678:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:10542:x1876028901327488:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:0.0:1789120820.181701:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120820.181723:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa516e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ade4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.181823:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.181837:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.181849:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120820.181860:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789120820.182280:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa516e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ade4 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.182302:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ade4 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.182311:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120820.182325:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120820.182330:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120820.182398:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10542:x1876028901327488:12345-192.168.206.9@tcp:101:cat.0 Request processed in 723us (2933us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789120820.182406:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:0.0:1789120820.188433:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.188523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.188619:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901327744 00000100:00100000:2.0:1789120820.188628:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901327744 00000100:00100000:2.0:1789120820.188688:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120820.188705:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10542:x1876028901327744:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:2.0:1789120820.188968:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:10542:x1876028901327744:12345-192.168.206.9@tcp:35:cat.0 Request processed in 271us (543us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789120820.188977:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:1.0:1789120820.189400:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901327872 00000100:00100000:1.0:1789120820.189405:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901327872 00000100:00100000:1.0:1789120820.189489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789120820.189498:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:2350:x1876028901327872:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120820.189509:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120820.189532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ade4 expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.189548:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:1.0:1789120820.189553:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120820.189589:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:2350:x1876028901327872:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 92us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120820.189596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789120820.252338:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.253369:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901328128 00000100:00100000:0.0:1789120820.253382:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901328128 00000100:00100000:0.0:1789120820.253498:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:0.0:1789120820.253509:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10548:x1876028901328128:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:0.0:1789120820.253531:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120820.253535:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789120820.253561:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa50db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adba expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253579:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120820.253597:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120820.253613:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5183 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adeb expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253711:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253724:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253733:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253778:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.253791:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 36 pid: 5858 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120820.253803:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922331520:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120820.253923:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120820.262836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120820.264398:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901328256 00000100:00100000:1.0:1789120820.264412:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901328256 00010000:00010000:1.0:1789120820.264458:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 37 pid: 5858 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120820.264525:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:1.0:1789120820.264534:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:2349:x1876028901328256:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120820.264548:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120820.264554:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 37 pid: 5858 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.264567:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 37 pid: 5858 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.264596:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:1.0:1789120820.264600:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.264610:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.264617:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120820.264635:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120820.264691:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:2349:x1876028901328256:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 158us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120820.264698:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00010000:00010000:3.0:1789120820.265600:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8addd expref: 36 pid: 5858 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120820.265620:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922331520:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120820.265644:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.265653:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.265659:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120820.265682:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789120820.265864:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5183 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 37 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.265880:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 36 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.265900:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120820.265902:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120820.265905:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b600, rc 0) 00000100:00100000:3.0:1789120820.265965:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10548:x1876028901328128:12345-192.168.206.9@tcp:101:dd.0 Request processed in 12458us (13715us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789120820.265973:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:0.0:1789120820.279740:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.279827:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901328512 00000100:00100000:2.0:1789120820.279835:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901328512 00000100:00100000:2.0:1789120820.279888:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789120820.279897:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10548:x1876028901328512:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:2.0:1789120820.280175:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.280191:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.280202:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120820.280247:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789120820.280280:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001095f3b9 reply state 0000000032db5c61 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120820.280289:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120820.280371:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:10548:x1876028901328512:12345-192.168.206.9@tcp:36:dd.0 Request processed in 474us (638us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789120820.280392:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000020:00080000:2.0:1789120820.280398:0:5858:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789120820.285942:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.285958:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.285966:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.285971:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120820.285976:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.285983:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.286002:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120820.286005:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120820.286010:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.286031:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5198 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120820.460977:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922331648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120820.461044:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120820.461270:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120820.461393:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922331648 00000100:00100000:2.0:1789120820.461400:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922331648 00000100:00100000:2.0:1789120820.461455:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789120820.461463:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922331648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120820.461495:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120820.461535:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922331648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120820.461542:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789120820.461602:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120820.461646:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5faa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922331648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120820.523141:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120820.523245:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901328640 00000100:00100000:3.0:1789120820.523255:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901328640 00000100:00100000:3.0:1789120820.523319:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789120820.523329:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:10562:x1876028901328640:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:3.0:1789120820.523355:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120820.523377:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa519f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adf2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523441:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523453:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523477:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523493:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523500:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523521:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523613:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523624:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 39 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523633:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523664:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 39 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.523677:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 39 pid: 8217 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120820.523691:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922331776:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120820.523819:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfb4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120820.537206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.537295:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901328896 00000100:00100000:0.0:1789120820.537305:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901328896 00000100:00100000:0.0:1789120820.537361:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789120820.537371:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:5588:x1876028901328896:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789120820.537889:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:5588:x1876028901328896:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 518us (690us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789120820.537898:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120820.538192:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922331776:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120820.538218:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120820.542357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.542570:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901329024 00000100:00100000:0.0:1789120820.542579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901329024 00010000:00010000:0.0:1789120820.542616:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 41 pid: 8217 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120820.542653:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:0.0:1789120820.542663:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:2350:x1876028901329024:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120820.542689:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120820.542696:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 41 pid: 8217 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542709:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 41 pid: 8217 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542730:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa518a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adeb expref: 41 pid: 8217 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542759:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120820.542764:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542773:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542791:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.542819:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120820.542881:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:2350:x1876028901329024:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 219us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120820.542889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00010000:00010000:3.0:1789120820.543691:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.543702:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120820.543755:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789120820.543760:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120820.543808:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.543821:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.543830:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544001:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544009:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544015:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120820.544019:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544027:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544038:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120820.544041:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120820.544045:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544051:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa51a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544083:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544089:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544095:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544100:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120820.544103:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544108:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544115:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cf800) 00010000:00010000:3.0:1789120820.544117:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120820.544120:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544126:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544192:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa519f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf2 expref: 40 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544207:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf2 expref: 39 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.544225:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120820.544227:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120820.544230:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:3.0:1789120820.544278:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:10562:x1876028901328640:12345-192.168.206.9@tcp:101:stat.0 Request processed in 20950us (21147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120820.544286:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:1.0:1789120820.622778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.623010:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901329280 00000100:00100000:2.0:1789120820.623020:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901329280 00000100:00100000:0.0:1789120820.623261:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:0.0:1789120820.623273:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:10568:x1876028901329280:12345-192.168.206.9@tcp:36:truncate.0 00010000:00010000:0.0:1789120820.623326:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120820.623352:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa51b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf2 expref: 39 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.623371:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120820.623376:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120820.623651:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.623665:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.623692:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120820.623762:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789120820.623789:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009688e4b4 reply state 0000000082692a7c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120820.623798:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120820.624327:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:10568:x1876028901329280:12345-192.168.206.9@tcp:36:truncate.0 Request processed in 1055us (1556us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789120820.624336:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00000020:00080000:0.0:1789120820.624341:0:5857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789120820.628373:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628391:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628399:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628405:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120820.628409:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628416:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628431:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120820.628434:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120820.628439:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.628445:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120820.818252:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120820.818401:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901329408 00000100:00100000:0.0:1789120820.818411:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901329408 00000100:00100000:0.0:1789120820.818468:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789120820.818478:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:10582:x1876028901329408:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:0.0:1789120820.818512:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120820.818535:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8adf9 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818600:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818615:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818629:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818659:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818667:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818674:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818772:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818781:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818788:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120820.818822:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789120820.818827:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120820.818862:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818873:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818881:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818887:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818916:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818923:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120820.818928:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818936:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818948:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120820.818951:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120820.818956:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818962:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa51c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818976:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818982:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818988:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.818993:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120820.818996:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819012:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819400:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120820.819404:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120820.819408:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819415:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa51d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819450:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa51c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 42 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819463:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120820.819471:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120820.819473:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120820.819476:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4be00, rc 0) 00000100:00100000:0.0:1789120820.820604:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:10582:x1876028901329408:12345-192.168.206.9@tcp:101:stat.0 Request processed in 2121us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120820.820615:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789120820.895616:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.897617:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901329664 00000100:00100000:2.0:1789120820.897631:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901329664 00000100:00100000:2.0:1789120820.897766:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:2.0:1789120820.897778:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:10592:x1876028901329664:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120820.897798:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120820.897816:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa51de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae00 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120820.897947:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789120820.898061:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa51de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae00 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.898074:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120820.898077:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120820.898094:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa51de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae00 expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.898110:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5200, rc 0) 00000100:00100000:2.0:1789120820.898236:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d076d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:10592:x1876028901329664:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 460us (2629us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789120820.898245:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789120820.901350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.903567:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901329920 00000100:00100000:2.0:1789120820.903583:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901329920 00000100:00100000:2.0:1789120820.903662:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789120820.903673:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:10592:x1876028901329920:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120820.903942:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:10592:x1876028901329920:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 270us (2605us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789120820.903951:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:1.0:1789120820.984757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120820.985257:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901330176 00000100:00100000:3.0:1789120820.985266:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901330176 00000100:00100000:3.0:1789120820.985327:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789120820.985348:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:10598:x1876028901330176:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120820.985372:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120820.985392:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa51ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae07 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.985546:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.985561:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 44 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.985570:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.985607:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 44 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.985621:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 44 pid: 8217 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120820.985634:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5904f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922331904:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120820.985729:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfb4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120820.989560:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5904f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922331904:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120820.989605:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120820.989729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120820.990324:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901330304 00000100:00100000:2.0:1789120820.990332:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901330304 00010000:00010000:2.0:1789120820.990371:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 45 pid: 8217 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120820.990415:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789120820.990424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+45:2350:x1876028901330304:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120820.990437:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120820.990445:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 45 pid: 8217 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990468:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 45 pid: 8217 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa51d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adf9 expref: 45 pid: 8217 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990533:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:2.0:1789120820.990539:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990549:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990556:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120820.990580:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120820.990675:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+44:2350:x1876028901330304:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 252us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120820.990683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00010000:00010000:3.0:1789120820.990949:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.990958:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120820.990976:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789120820.991126:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa51ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 45 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.991201:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 44 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120820.991209:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120820.991212:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120820.991215:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a400, rc 0) 00000100:00100000:3.0:1789120820.991243:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+44:10598:x1876028901330176:12345-192.168.206.9@tcp:101:bash.0 Request processed in 5897us (6496us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789120820.991249:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:1.0:1789120821.001624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.001726:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901330560 00000100:00100000:0.0:1789120821.001736:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901330560 00000100:00100000:0.0:1789120821.001854:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:0.0:1789120821.001864:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+44:10598:x1876028901330560:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:0.0:1789120821.002137:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.002192:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.002204:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120821.002261:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789120821.002286:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ff808d9c reply state 0000000045535093 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120821.002296:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120821.002388:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10598:x1876028901330560:12345-192.168.206.9@tcp:36:bash.0 Request processed in 524us (772us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789120821.002396:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000020:00080000:0.0:1789120821.002400:0:5857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1789120821.003933:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789120821.004866:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004880:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004888:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004895:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.004899:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004918:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004948:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120821.004951:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.004956:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.004963:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5201 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120821.008993:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.009659:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901330688 00000100:00100000:0.0:1789120821.009669:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901330688 00000100:00100000:0.0:1789120821.012934:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:0.0:1789120821.012961:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+46:10598:x1876028901330688:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120821.012985:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120821.013006:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae0e expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.013110:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.013134:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 47 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.013172:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.013211:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 47 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.013225:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 47 pid: 5859 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120821.013255:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922332032:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120821.013367:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789120821.023177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.023394:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901330816 00000100:00100000:3.0:1789120821.023414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901330816 00010000:00010000:3.0:1789120821.023465:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 48 pid: 5859 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120821.023508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:3.0:1789120821.023518:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:2350:x1876028901330816:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120821.023540:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120821.023547:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 48 pid: 5859 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.023560:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 48 pid: 5859 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.023582:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120821.023587:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.023596:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.023604:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.023621:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120821.023669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:2350:x1876028901330816:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 152us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.023677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00010000:00010000:0.0:1789120821.023941:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa51f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae07 expref: 47 pid: 5859 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120821.023959:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0752c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922332032:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120821.023980:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.023989:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.023995:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120821.024050:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789120821.024055:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120821.024073:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.024103:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae0e expref: 47 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.024117:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae0e expref: 46 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.024125:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120821.024135:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120821.024138:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a600, rc 0) 00000100:00100000:0.0:1789120821.024335:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+46:10598:x1876028901330688:12345-192.168.206.9@tcp:101:bash.0 Request processed in 11388us (15350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.024343:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:1.0:1789120821.027633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.027772:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901331072 00000100:00100000:2.0:1789120821.027781:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901331072 00000100:00100000:2.0:1789120821.027828:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789120821.027837:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+46:10598:x1876028901331072:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789120821.028112:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10598:x1876028901331072:12345-192.168.206.9@tcp:35:bash.0 Request processed in 275us (489us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789120821.028121:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789120821.132507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.132599:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901331328 00000100:00100000:3.0:1789120821.132609:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901331328 00000100:00100000:3.0:1789120821.132668:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:3.0:1789120821.132678:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10608:x1876028901331328:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120821.132701:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120821.132724:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae15 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120821.132866:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789120821.132997:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5216 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae15 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.133011:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:3.0:1789120821.133014:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120821.133032:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae15 expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.133046:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a600, rc 0) 00000100:00100000:3.0:1789120821.133106:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:10608:x1876028901331328:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 429us (607us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789120821.133114:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:1.0:1789120821.145096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.145190:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901331456 00000100:00100000:3.0:1789120821.145199:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901331456 00000100:00100000:3.0:1789120821.145260:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789120821.145270:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:10608:x1876028901331456:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:3.0:1789120821.145339:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145357:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145368:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145381:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145413:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145421:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145523:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145532:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145539:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120821.145578:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145589:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145596:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145604:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145610:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.145614:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145621:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145638:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120821.145641:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120821.145646:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145653:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145665:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145671:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145677:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145683:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.145686:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145692:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145698:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cf800) 00010000:00010000:3.0:1789120821.145701:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120821.145703:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145709:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa522b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145731:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145737:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145743:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145748:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.145751:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145757:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145764:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120821.145766:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120821.145768:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.145774:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120821.145842:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:10608:x1876028901331456:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 574us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.145850:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:1.0:1789120821.150881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.151085:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901331712 00000100:00100000:2.0:1789120821.151095:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901331712 00000100:00100000:2.0:1789120821.151335:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789120821.151347:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:10608:x1876028901331712:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120821.151751:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10608:x1876028901331712:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 406us (878us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789120821.151761:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789120821.211476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.211640:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901331968 00000100:00100000:3.0:1789120821.211653:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901331968 00000100:00100000:3.0:1789120821.211724:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:3.0:1789120821.211754:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10611:x1876028901331968:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120821.211794:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120821.211820:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae1c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211921:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211939:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211952:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211968:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211975:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.211981:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212187:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa524e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212198:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212205:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120821.212229:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789120821.212358:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212366:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212374:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212380:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.212385:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212393:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212406:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120821.212410:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120821.212416:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212423:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212439:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212445:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212658:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212664:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.212667:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212675:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212684:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cf800) 00010000:00010000:3.0:1789120821.212686:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120821.212689:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212696:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212753:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae1c expref: 52 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212769:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae1c expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.212776:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120821.212840:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120821.212844:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ae00, rc 0) 00000100:00100000:3.0:1789120821.212932:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:10611:x1876028901331968:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1179us (1480us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789120821.212951:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789120821.218034:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120821.218073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.218211:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901332224 00000100:00100000:3.0:1789120821.218221:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901332224 00000100:00100000:2.0:1789120821.218252:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901332096 00000100:00100000:3.0:1789120821.218280:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:3.0:1789120821.218293:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:10611:x1876028901332224:12345-192.168.206.9@tcp:54:lfs.0 00000100:00100000:2.0:1789120821.218328:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901332096 00010000:00010000:3.0:1789120821.218364:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218384:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218396:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120821.218419:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00010000:00010000:3.0:1789120821.218424:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120821.218435:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:2350:x1876028901332096:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120821.218445:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.218457:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120821.218469:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218478:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120821.218483:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218491:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218503:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:3.0:1789120821.218520:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120821.218526:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.218533:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa525c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120821.218612:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10611:x1876028901332224:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 321us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.218625:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00010000:00010000:2.0:1789120821.218815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa524e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae1c expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.218833:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:2.0:1789120821.218838:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120821.218912:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:2350:x1876028901332096:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 475us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.218921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789120821.225661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.225792:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901332480 00000100:00100000:0.0:1789120821.225805:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901332480 00000100:00100000:0.0:1789120821.225874:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789120821.225895:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:10611:x1876028901332480:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120821.226249:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:10611:x1876028901332480:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 356us (600us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789120821.226259:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:1.0:1789120821.382773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.382910:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901332736 00000100:00100000:0.0:1789120821.382920:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901332736 00000100:00100000:0.0:1789120821.382978:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:0.0:1789120821.382989:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:10629:x1876028901332736:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:0.0:1789120821.383011:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120821.383030:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae23 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.383129:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa526a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.383361:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa526a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.383375:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa526a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120821.383509:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789120821.383637:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae23 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.383656:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa526a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae23 expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.383664:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120821.383667:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789120821.383670:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b600, rc 0) 00000100:00100000:0.0:1789120821.383730:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10629:x1876028901332736:12345-192.168.206.9@tcp:101:cat.0 Request processed in 744us (966us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789120821.383738:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:1.0:1789120821.411014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.411093:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901332864 00000100:00100000:0.0:1789120821.411103:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901332864 00000100:00100000:0.0:1789120821.411195:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:0.0:1789120821.411206:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10630:x1876028901332864:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120821.411230:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120821.411250:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae2a expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411311:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411326:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411355:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120821.411423:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789120821.411427:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120821.411446:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411469:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae2a expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411486:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae2a expref: 54 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.411495:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120821.411497:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120821.411501:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120821.411556:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10630:x1876028901332864:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 353us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.411563:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:1.0:1789120821.418221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.418744:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333248 00000100:00100000:0.0:1789120821.418755:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333248 00000100:00100000:0.0:1789120821.418867:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:0.0:1789120821.418878:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10630:x1876028901333248:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120821.419234:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10630:x1876028901333248:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 357us (1020us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789120821.419244:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789120821.421113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.421416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333376 00000100:00100000:0.0:1789120821.421424:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333376 00000100:00100000:0.0:1789120821.421521:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:0.0:1789120821.421530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10630:x1876028901333376:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:0.0:1789120821.421545:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789120821.421569:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa520f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae0e expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.421589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa526a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae23 expref: 54 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.421602:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa511a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8adcf expref: 53 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.421612:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf900) 00010000:00010000:0.0:1789120821.421623:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120821.421683:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10630:x1876028901333376:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 154us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.421690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789120821.425414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.425491:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333504 00000100:00100000:3.0:1789120821.425501:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333504 00000100:00100000:3.0:1789120821.425566:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:3.0:1789120821.425575:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10630:x1876028901333504:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:3.0:1789120821.425711:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.425727:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.425737:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120821.426382:0:5858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120821.426662:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789120821.426749:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789120821.427360:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10630:x1876028901333504:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 1781us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.427371:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:3.0:1789120821.463427:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.463515:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333632 00000100:00100000:0.0:1789120821.463524:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333632 00000100:00100000:0.0:1789120821.463585:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:0.0:1789120821.463595:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10632:x1876028901333632:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120821.463613:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120821.463631:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa528d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae31 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463712:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463726:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463749:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463765:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463773:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463779:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463870:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.463988:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464000:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120821.464037:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789120821.464041:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120821.464059:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464081:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464090:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464096:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464101:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464107:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.464111:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464118:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464128:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120821.464131:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.464135:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464141:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464469:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464477:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464491:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464496:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.464499:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464506:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464515:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120821.464518:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.464521:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464527:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa529b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464565:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa528d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 54 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464579:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 53 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.464586:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:0.0:1789120821.464588:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120821.464591:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:1.0:1789120821.472069:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5904f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10632:x1876028901333632:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 8464us (8639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120821.472082:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00010000:00010000:2.0:1789120821.483140:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120821.741309:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120821.741315:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120821.741359:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789120821.741365:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120821.741482:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa8780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922332160:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120821.741592:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120821.745405:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa8780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922332160:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120821.762429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.767041:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333760 00000100:00100000:0.0:1789120821.767056:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333760 00000100:00100000:0.0:1789120821.768659:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789120821.768677:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901333760:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789120821.768764:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901333760:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 Request processed in 94us (6342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.768773:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789120821.774909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120821.775034:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901333888 00000100:00100000:1.0:1789120821.775045:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901333888 00000100:00100000:1.0:1789120821.775103:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:1.0:1789120821.775113:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901333888:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120821.775190:0:5857:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120821.775292:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901333888:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 181us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120821.775300:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:3.0:1789120821.781917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.782267:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901334016 00000100:00100000:0.0:1789120821.782277:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901334016 00000100:00100000:0.0:1789120821.782328:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:0.0:1789120821.782337:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901334016:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789120821.782409:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782425:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782438:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782498:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782506:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782513:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782539:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782559:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782566:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120821.782607:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789120821.782612:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120821.782624:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782634:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782640:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782647:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782653:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.782657:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782664:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782675:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:0.0:1789120821.782678:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.782683:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782700:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa52a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782712:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782717:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782722:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782726:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.782729:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782735:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782741:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120821.782743:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.782746:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782751:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa52b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782763:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782768:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782778:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782782:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.782785:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782790:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782797:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:0.0:1789120821.782798:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120821.782801:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.782807:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa52b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120821.782873:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901334016:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 536us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.782880:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:2.0:1789120821.787575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120821.787822:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901334272 00000100:00100000:1.0:1789120821.787832:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901334272 00000100:00100000:1.0:1789120821.787891:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:1.0:1789120821.787913:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10643:x1876028901334272:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120821.787933:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120821.787953:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae38 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788047:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788062:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788075:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120821.788086:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789120821.788321:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788329:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788335:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788351:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120821.788356:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788363:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788376:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:1.0:1789120821.788379:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120821.788384:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788391:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788434:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52be lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae38 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788445:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:1.0:1789120821.788447:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120821.788450:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae38 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.788460:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120821.788562:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901334272:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 662us (997us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789120821.788569:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:3.0:1789120821.796823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.798192:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901334400 00000100:00100000:0.0:1789120821.798202:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901334400 00000100:00100000:0.0:1789120821.798333:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:0.0:1789120821.798342:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901334400:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789120821.798374:0:5859:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789120821.799583:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901334400:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 1178us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120821.799611:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:3.0:1789120821.805822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.805953:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901334656 00000100:00100000:2.0:1789120821.805963:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901334656 00000100:00100000:2.0:1789120821.806028:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:2.0:1789120821.806039:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901334656:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120821.806067:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120821.806070:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120821.806097:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa527f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae2a expref: 54 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806115:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120821.806120:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120821.806133:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa52d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae3f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120821.806570:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789120821.806770:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa52da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806784:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa52da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806800:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa52da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806851:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa52d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae3f expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806887:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa52da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae3f expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.806895:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3a00) 00010000:00010000:2.0:1789120821.806907:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120821.806911:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120821.806979:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10643:x1876028901334656:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 942us (1168us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789120821.806987:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:2.0:1789120821.815693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120821.815775:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901334912 00000100:00100000:1.0:1789120821.815795:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901334912 00000100:00100000:1.0:1789120821.815850:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789120821.815859:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10643:x1876028901334912:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120821.815921:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120821.815947:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa52da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae3f expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.815966:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3a00) 00010000:00010000:1.0:1789120821.815977:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120821.815997:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816010:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816019:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816031:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816038:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816044:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816108:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816114:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816127:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816132:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120821.816136:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816184:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816193:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:1.0:1789120821.816196:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120821.816200:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816206:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa52e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816215:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816221:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816227:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816232:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120821.816235:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816249:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816257:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78b8dccd (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120821.816259:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120821.816261:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120821.816267:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa52ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78b8dccd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120821.816331:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901334912:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 472us (645us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120821.816338:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:3.0:1789120821.823771:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.823859:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335040 00000100:00100000:2.0:1789120821.823868:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335040 00000100:00100000:2.0:1789120821.823927:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:2.0:1789120821.823936:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10643:x1876028901335040:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120821.823954:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120821.823973:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa52f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae46 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824005:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824026:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824037:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824171:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa52f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824190:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.824197:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120821.824200:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120821.824203:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4400, rc 0) 00000100:00100000:2.0:1789120821.824264:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10643:x1876028901335040:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 329us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.824271:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:3.0:1789120821.827019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120821.827187:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335296 00000100:00100000:0.0:1789120821.827196:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335296 00000100:00100000:0.0:1789120821.827246:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:0.0:1789120821.827256:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10643:x1876028901335296:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120821.827333:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.827348:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.827358:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789120821.827648:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789120821.827659:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289081514477ns, next at 290081512129ns, rc = 0 00000004:00010000:0.0:1789120821.827743:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000021f64af7 reply state 0000000044c07ee6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120821.827752:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120821.827840:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10643:x1876028901335296:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 585us (837us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789120821.827848:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00010000:00010000:0.0:1789120821.831218:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831233:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831256:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831262:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120821.831267:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831275:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831290:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:0.0:1789120821.831293:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789120821.831299:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120821.831305:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5304 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120821.831454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.831540:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335424 00000100:00100000:2.0:1789120821.831549:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335424 00000100:00100000:2.0:1789120821.831605:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789120821.831615:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10643:x1876028901335424:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120821.831747:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120821.831765:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae4d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.831819:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.831832:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.831864:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120821.831867:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120821.831870:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4000, rc 0) 00000100:00100000:2.0:1789120821.831939:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10643:x1876028901335424:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 325us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.831946:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:3.0:1789120821.836843:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.836877:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335552 00000100:00100000:3.0:1789120821.836886:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335552 00000100:00100000:3.0:1789120821.836931:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:3.0:1789120821.836940:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901335552:12345-192.168.206.9@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789120821.836970:0:6707:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1789120821.836994:0:6707:0:(genops.c:1385:class_connect()) connect: client 76510092-6f58-4075-a7f3-7af5ca8b7da2, cookie 0x13cfa3d77faa5312 00002000:00100000:3.0:1789120821.837006:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76510092-6f58-4075-a7f3-7af5ca8b7da2/ffff9ffd9059a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789120821.837026:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789120821.837249:0:6707:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789120821.837283:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffd9059a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120821.837341:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2348:x1876028901335552:12345-192.168.206.9@tcp:8:lhsmtool_posix.0 Request processed in 401us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.837350:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:1.0:1789120821.845885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.845996:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335680 00000100:00100000:2.0:1789120821.846005:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335680 00000100:00080000:1.0:1789120821.846117:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120821.846225:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:2.0:1789120821.846236:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:0:x1876028901335680:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1789120821.897347:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1789120821.897361:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000100:00100000:1.0:1789120821.897795:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:0:x1876028901335680:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 51556us (51915us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789120821.897806:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789120821.901399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.904140:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901335936 00000100:00100000:2.0:1789120821.904167:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901335936 00000100:00100000:2.0:1789120821.904236:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789120821.904246:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10643:x1876028901335936:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789120821.904471:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10643:x1876028901335936:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 226us (3081us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789120821.904480:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:2.0:1789120821.909850:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.915312:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336192 00000100:00100000:3.0:1789120821.915324:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336192 00000100:00100000:1.0:1789120821.915659:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:1.0:1789120821.915669:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10643:x1876028901336192:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120821.915834:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10643:x1876028901336192:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 166us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120821.915842:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:1.0:1789120821.927247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.930924:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336320 00000100:00100000:2.0:1789120821.930938:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336320 00000100:00100000:2.0:1789120821.931000:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:2.0:1789120821.931010:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10643:x1876028901336320:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120821.931042:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120821.931062:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae54 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931140:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931178:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931189:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120821.931233:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120821.931249:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931274:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae54 expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931289:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae54 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.931297:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120821.931301:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789120821.931304:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4a00, rc 0) 00000100:00100000:2.0:1789120821.931366:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10643:x1876028901336320:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 357us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.931374:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:3.0:1789120821.934326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.934371:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336448 00000100:00100000:2.0:1789120821.934380:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336448 00000100:00100000:2.0:1789120821.934435:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:2.0:1789120821.934445:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901336448:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120821.934460:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120821.934479:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae5b expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120821.934504:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d135, blocks: 0x1 00010000:00010000:2.0:1789120821.934538:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1789120821.934543:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120821.934553:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.934571:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.934583:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120821.934640:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901336448:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 197us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.934648:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:3.0:1789120821.943059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.943099:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336704 00000100:00100000:3.0:1789120821.943107:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336704 00000100:00100000:3.0:1789120821.943185:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:3.0:1789120821.943196:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10643:x1876028901336704:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120821.943303:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10643:x1876028901336704:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.943311:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:2.0:1789120821.962828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.962942:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336832 00000100:00100000:3.0:1789120821.962951:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336832 00000100:00100000:3.0:1789120821.963018:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:3.0:1789120821.963028:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:10643:x1876028901336832:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120821.963045:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120821.963064:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae62 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.963092:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.963100:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120821.963103:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120821.963108:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.963162:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120821.963175:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120821.963188:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1876028922332288:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120821.963285:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120821.968799:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1876028922332288:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120821.968832:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.968870:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b800, rc 0) 00000100:00100000:2.0:1789120821.968950:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:10643:x1876028901336832:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 5923us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.968958:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:3.0:1789120821.979845:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120821.980043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901336960 00000100:00100000:2.0:1789120821.980053:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901336960 00010000:00010000:2.0:1789120821.980100:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120821.980167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789120821.980177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901336960:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120821.980192:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120821.980215:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.980228:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.980252:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ffd2827/0x13cfa3d77faa5327 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae5b expref: 7 pid: 6707 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.980270:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120821.980275:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120821.980283:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.980308:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120821.980346:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120821.980360:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5842:1876028922332416:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789120821.980615:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120821.990950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120821.991009:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5842:1876028922332416:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789120821.992226:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120821.992286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901336960:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 12108us (12447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.992296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:0.0:1789120821.994058:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337088 00000100:00100000:0.0:1789120821.994070:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337088 00002000:00100000:0.0:1789120821.994124:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ffdb96d7840 x1876028901337088/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:352/0 lens 504/0 e 0 to 0 dl 1789120832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120821.994135:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb96d7840 with x1876028901337088 ext(0->8) 00002000:00010000:0.0:1789120821.994140:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb96d7840 00000100:00100000:0.0:1789120821.994210:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789120821.994221:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901337088:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000004:00080000:3.0:1789120821.995218:0:7865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 289249072107ns, next at 290249070249ns, rc = 0 00000100:00100000:3.0:1789120821.995242:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120821.995300:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120821.995349:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922332544 00000100:00100000:3.0:1789120821.995355:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922332544 00000100:00100000:3.0:1789120821.995394:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120821.995402:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922332544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120821.995429:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120821.995469:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922332544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120821.995475:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789120821.995494:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120821.995524:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922332544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120821.999106:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901337088:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 4880us (8158us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789120821.999126:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00002000:00100000:0.0:1789120821.999136:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ffdb96d7840 x1876028901337088/t4294967302(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:352/0 lens 504/448 e 0 to 0 dl 1789120832 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120821.999164:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb96d7840 with x1876028901337088 ext(0->8) 00002000:00010000:0.0:1789120821.999170:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb96d7840 00000100:00100000:3.0:1789120822.004880:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922332928:0@lo:400:kworker.0 00000100:00100000:3.0:1789120822.004955:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120822.004990:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120822.004996:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922333056:0@lo:400:kworker.0 00000100:00100000:3.0:1789120822.005044:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120822.005229:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922332672:0@lo:400:kworker.0 00000100:00100000:0.0:1789120822.005263:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120822.005299:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922333184:0@lo:400:kworker.0 00000100:00100000:0.0:1789120822.005322:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120822.005341:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120822.005346:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922332800:0@lo:400:kworker.0 00000100:00100000:0.0:1789120822.005368:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120822.005397:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922332928 00000100:00100000:0.0:1789120822.005404:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922332928 00000100:00100000:0.0:1789120822.005450:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922333184 00000100:00100000:0.0:1789120822.005453:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922333184 00000100:00100000:0.0:1789120822.005469:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922332800 00000100:00100000:0.0:1789120822.005471:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922332800 00000100:00100000:0.0:1789120822.005484:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789120822.005492:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922332928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120822.005648:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922332672 00000100:00100000:1.0:1789120822.005652:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922332672 00000100:00100000:1.0:1789120822.005689:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789120822.005696:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922332672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120822.005763:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922333056 00000100:00100000:3.0:1789120822.005767:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922333056 00000100:00100000:3.0:1789120822.005796:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120822.005802:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922333056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120822.005996:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922332672:12345-0@lo:400:kworker.0 Request processed in 300us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120822.006005:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789120822.006087:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922332672:0@lo:400:kworker.0 00000100:00100000:2.0:1789120822.006244:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120822.006252:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922333184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120822.006294:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922333184:12345-0@lo:400:kworker.0 Request processed in 43us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120822.006300:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120822.006315:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789120822.006321:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120822.006344:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922332800:12345-0@lo:400:kworker.0 Request processed in 24us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120822.006350:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120822.009632:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922332800:0@lo:400:kworker.0 00000100:00100000:1.0:1789120822.009649:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922333184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120822.014390:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922333056:12345-0@lo:400:kworker.0 Request processed in 8580us (9338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.014404:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120822.014483:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.014510:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337216 00000100:00100000:3.0:1789120822.014517:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337216 00000100:00100000:3.0:1789120822.014625:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:3.0:1789120822.014633:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10643:x1876028901337216:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789120822.016673:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922332928:12345-0@lo:400:kworker.0 Request processed in 11175us (11711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120822.016688:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789120822.016945:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120822.016951:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120822.017322:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922333056:0@lo:400:kworker.0 00000100:00100000:1.0:1789120822.017337:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922332928:0@lo:400:kworker.0 00000001:00080000:2.0:1789120822.065401:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1789120822.065413:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789120822.065634:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10643:x1876028901337216:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 50995us (51146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120822.065650:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000001:00080000:2.0:1789120822.065729:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789120822.065748:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789120822.066215:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffd87214b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789120822.066221:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd9d224000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffd87214c00 00000020:00080000:2.0:1789120822.066223:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffda0de6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb59bac00 00000004:00080000:2.0:1789120822.066243:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789120822.066280:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789120822.066391:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789120822.066471:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120822.066485:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922333312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789120822.066548:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120822.066628:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922333440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789120822.066658:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120822.066934:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922333312 00000100:00100000:2.0:1789120822.066941:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922333312 00000100:00100000:2.0:1789120822.066985:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922333440 00000100:00100000:2.0:1789120822.066989:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922333440 00000100:00100000:2.0:1789120822.067023:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120822.067031:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922333312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789120822.067055:0:6706:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789120822.067086:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3d133, atime: 0x6aa3d133, ctime: 0x6aa3d133, blocks: 0x1 00010000:00010000:2.0:1789120822.067094:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067109:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1789120822.067113:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1789120822.067119:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789120822.067119:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.067128:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922333440:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789120822.067134:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067170:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067179:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120822.067264:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789120822.067267:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789120821 00002000:00010000:3.0:1789120822.067269:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789120822.067271:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789120821 -> 1789120821 00002000:00010000:3.0:1789120822.067274:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1789120822.067274:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120822.067314:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922333440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (655us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789120822.067321:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1789120822.067360:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdc1e6fc00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789120822.067371:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922333440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789120822.067778:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1876028922333312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 747us (1229us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789120822.067785:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789120822.067813:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120822.067820:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067828:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120822.067833:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067842:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067858:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067865:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.067880:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120822.067881:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120822.067883:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789120822.067950:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffd9d075680/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789120822.067957:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922333312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789120822.070992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.071200:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337344 00000100:00100000:3.0:1789120822.071209:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337344 00000100:00100000:3.0:1789120822.071272:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:3.0:1789120822.071283:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2352:x1876028901337344:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789120822.107788:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2352:x1876028901337344:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 36498us (36795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.107801:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000001:00080000:2.0:1789120822.108060:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789120822.108074:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789120822.111342:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.111415:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337600 00000100:00100000:0.0:1789120822.111424:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337600 00000100:00100000:0.0:1789120822.111489:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:0.0:1789120822.111499:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10643:x1876028901337600:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120822.111553:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120822.111579:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae54 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.111596:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:0.0:1789120822.111601:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120822.111626:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.111639:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.111647:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120822.111854:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f72da601 reply state 00000000699ff149 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.111863:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120822.111972:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10643:x1876028901337600:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 474us (639us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789120822.111980:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00010000:00010000:0.0:1789120822.114077:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114094:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114101:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114108:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120822.114112:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114120:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114138:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:0.0:1789120822.114192:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120822.114198:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.114205:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa533c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.116872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.116970:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337728 00000100:00100000:3.0:1789120822.116983:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337728 00000100:00100000:3.0:1789120822.117073:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:3.0:1789120822.117084:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901337728:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789120822.117356:0:8216:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789120822.117360:0:8216:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789120821 -> 1789120820 00002000:00010000:3.0:1789120822.117363:0:8216:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789120819 00002000:00010000:3.0:1789120822.117365:0:8216:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789120821 -> 1789120820 00002000:00010000:3.0:1789120822.117367:0:8216:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789120822.117426:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901337728:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 343us (564us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789120822.117434:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:3.0:1789120822.120312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.120421:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901337984 00000100:00100000:0.0:1789120822.120431:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901337984 00000100:00100000:0.0:1789120822.120498:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:0.0:1789120822.120507:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10643:x1876028901337984:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789120822.120600:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.120615:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.120624:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.120658:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.120671:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 13 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.120684:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922333568:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120822.120778:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120822.123765:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922333568:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120822.123794:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.125277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.125802:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338112 00000100:00100000:0.0:1789120822.125810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338112 00010000:00010000:0.0:1789120822.125847:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.125888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:0.0:1789120822.125908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2349:x1876028901338112:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120822.125937:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120822.125945:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.125958:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.125979:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa52fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae46 expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.125996:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:0.0:1789120822.126001:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.126021:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.126028:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.126295:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120822.126345:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:2349:x1876028901338112:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 448us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120822.126353:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00010000:00010000:1.0:1789120822.127231:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127242:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127271:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127278:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127296:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127302:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120822.127306:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127314:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127326:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:1.0:1789120822.127329:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789120822.127333:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.127340:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5343 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.127581:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:10643:x1876028901337984:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 7072us (7273us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789120822.127591:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:3.0:1789120822.132289:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.132702:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338240 00000100:00100000:0.0:1789120822.132712:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338240 00000100:00100000:0.0:1789120822.132769:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789120822.132779:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901338240:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789120822.132839:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.132858:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.132867:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120822.132872:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120822.132877:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.132921:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.132936:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 7 pid: 8216 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.132952:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922333696:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120822.133037:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120822.139063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.139175:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922333696:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120822.139202:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.139694:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338368 00000100:00100000:3.0:1789120822.139702:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338368 00010000:00010000:3.0:1789120822.139739:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 8 pid: 8216 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.139799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789120822.139809:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0244c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901338368:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120822.139823:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120822.139844:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 8 pid: 8216 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.139855:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 8 pid: 8216 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.139876:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa532e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae62 expref: 8 pid: 8216 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.139892:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120822.139908:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120822.139914:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.139923:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.139955:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120822.140060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0244c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901338368:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 251us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.140068:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00010000:00010000:1.0:1789120822.140220:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140231:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140258:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140267:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140282:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140289:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120822.140293:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140302:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140314:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.140322:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118a3be8/0x13cfa3d77faa534a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120822.140366:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901338240:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 7588us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120822.140374:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:2.0:1789120822.143307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.143390:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338624 00000100:00100000:0.0:1789120822.143402:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338624 00000100:00100000:0.0:1789120822.143519:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:0.0:1789120822.143549:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:10643:x1876028901338624:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789120822.143627:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.143643:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.143654:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.143867:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.143878:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.143886:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.144101:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.144118:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 13 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.144131:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922333824:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120822.144379:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120822.150735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.150867:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338752 00000100:00100000:2.0:1789120822.150876:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338752 00010000:00010000:2.0:1789120822.150923:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.150961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:2.0:1789120822.150972:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2349:x1876028901338752:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120822.150985:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120822.150991:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.151002:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 14 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.151035:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120822.151040:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.151049:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.151055:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.151100:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120822.151175:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2349:x1876028901338752:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 204us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120822.151183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00010000:00010000:0.0:1789120822.152393:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa530b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae4d expref: 13 pid: 5858 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.152426:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922333824:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120822.152623:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.152633:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.152639:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120822.152815:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789120822.152975:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789120822.153026:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789120822.153126:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1876028922333952:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789120822.153223:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120822.153250:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120822.153604:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922333952 00000100:00100000:3.0:1789120822.153611:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922333952 00000100:00100000:3.0:1789120822.153668:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120822.153677:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1876028922333952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789120822.153753:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1876028922333952:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.153760:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120822.153793:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789120822.153798:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdc1e6fc00, transno 4294967303 00000100:00100000:3.0:1789120822.153810:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d0761c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1876028922333952:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789120822.154352:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789120822.154420:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1876028922334080:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789120822.154457:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120822.154486:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120822.154759:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922334080 00000100:00100000:2.0:1789120822.154764:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922334080 00000100:00100000:2.0:1789120822.154792:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120822.154800:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1876028922334080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789120822.154992:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1876028922334080:12345-0@lo:1000:mdt00_000.0 Request processed in 191us (534us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789120822.154999:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120822.155186:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5857:1876028922334080:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789120822.155913:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155926:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155934:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155940:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.155945:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155953:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155970:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120822.155973:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120822.155983:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.155990:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5358 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158212:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158229:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158237:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158243:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.158247:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158255:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158270:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:2.0:1789120822.158274:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120822.158278:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158284:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5286 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158483:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158499:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158514:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158550:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.158565:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 16 pid: 8217 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.158580:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb96d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922334208:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120822.158671:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120822.169182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.169246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901338880 00000100:00100000:3.0:1789120822.169255:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901338880 00010000:00010000:3.0:1789120822.169290:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 17 pid: 8217 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.169331:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789120822.169339:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:2350:x1876028901338880:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120822.169353:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120822.169358:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 17 pid: 8217 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.169387:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 17 pid: 8217 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.169409:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:3.0:1789120822.169414:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.169424:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.169431:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.169458:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120822.169744:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:2350:x1876028901338880:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 165us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.169755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00010000:00010000:2.0:1789120822.170254:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa52a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae31 expref: 16 pid: 8217 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.170269:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb96d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922334208:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120822.170288:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170296:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170301:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170312:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170318:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170332:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170338:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.170342:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170349:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170360:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:2.0:1789120822.170363:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120822.170366:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170371:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa535f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170381:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170387:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170392:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170396:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.170398:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170413:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170421:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd831cf800) 00010000:00010000:2.0:1789120822.170423:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120822.170427:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.170432:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5351 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.170846:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10643:x1876028901338624:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 27298us (27559us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789120822.170856:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000020:00080000:2.0:1789120822.170860:0:5857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789120822.171706:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120822.171713:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120822.171743:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789120822.171749:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789120822.175602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.175726:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339136 00000100:00100000:3.0:1789120822.175736:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339136 00000100:00100000:3.0:1789120822.175786:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120822.175796:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10643:x1876028901339136:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789120822.176509:0:5861:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789120822.176688:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789120822.176745:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176760:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176772:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176780:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176785:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176791:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.176814:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120822.176912:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:10643:x1876028901339136:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1103us (1304us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789120822.176921:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000020:00080000:3.0:1789120822.176926:0:5861:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120822.177286:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120822.177294:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.177313:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120822.177317:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.177325:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.177338:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ffd831cf200) 00010000:00010000:1.0:1789120822.177341:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789120822.177345:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.177350:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5366 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.177365:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120822.177367:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120822.177369:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120822.350126:0:12403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120822.350136:0:12403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120822.350192:0:12403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789120822.350199:0:12403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789120822.510257:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120822.646658:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.646770:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339392 00000100:00100000:3.0:1789120822.646779:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339392 00000100:00100000:3.0:1789120822.647276:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:3.0:1789120822.647289:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:10653:x1876028901339392:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120822.647313:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120822.647335:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa536d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae69 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.647607:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5374 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.647622:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.647632:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120822.647644:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1789120822.648487:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa536d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae69 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.648508:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae69 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.648516:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120822.648519:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120822.648523:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b800, rc 0) 00000100:00100000:2.0:1789120822.652481:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:10653:x1876028901339392:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 5182us (5819us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789120822.652495:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:3.0:1789120822.665629:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.665727:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339520 00000100:00100000:0.0:1789120822.665736:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339520 00000100:00100000:0.0:1789120822.665805:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:0.0:1789120822.665816:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:10653:x1876028901339520:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789120822.665889:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.665941:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.665953:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.665980:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.665988:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.665996:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666626:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666636:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666643:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120822.666682:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666694:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666701:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666718:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666725:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120822.666729:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666736:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666746:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120822.666749:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120822.666753:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666758:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666768:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.666774:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667075:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667082:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120822.667085:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667102:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667110:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120822.667113:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120822.667116:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667122:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa5389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667136:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667276:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667283:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667287:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120822.667290:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667295:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667303:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120822.667305:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120822.667308:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.667322:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.667485:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:10653:x1876028901339520:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1669us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120822.667494:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:2.0:1789120822.711688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.711777:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.711824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.711862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.711892:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901340032 00000100:00100000:2.0:1789120822.711912:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901340032 00000100:00100000:3.0:1789120822.712127:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339904 00000100:00100000:3.0:1789120822.712131:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339904 00000100:00100000:3.0:1789120822.712197:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339776 00000100:00100000:3.0:1789120822.712211:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339776 00000100:00100000:3.0:1789120822.712235:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:3.0:1789120822.712244:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901339904:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120822.712327:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901339904:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 84us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.712352:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:3.0:1789120822.712369:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:3.0:1789120822.712376:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901339776:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120822.712402:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901339776:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.712408:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:2.0:1789120822.712645:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:2.0:1789120822.712656:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2350:x1876028901340032:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120822.712699:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2350:x1876028901340032:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 44us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120822.712714:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00080000:0.0:1789120822.713130:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120822.713137:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120822.713378:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901339648 00000100:00100000:1.0:1789120822.713386:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901339648 00000100:00100000:1.0:1789120822.713467:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 312 00000100:00100000:1.0:1789120822.713475:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901339648:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120822.713526:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901339648:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 52us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120822.713533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 312 00000100:00100000:3.0:1789120822.719763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.719937:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901340288 00000100:00100000:2.0:1789120822.719946:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901340288 00000100:00100000:2.0:1789120822.720006:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:2.0:1789120822.720016:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:10656:x1876028901340288:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120822.720246:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120822.720267:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae70 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720457:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720472:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720483:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720499:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720506:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.720512:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722404:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722439:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722462:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120822.722474:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789120822.722567:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722574:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722580:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722586:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.722590:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722596:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722607:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120822.722610:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120822.722614:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722619:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa539e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722632:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722643:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722649:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722654:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.722657:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722663:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722670:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120822.722672:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120822.722675:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722681:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa53a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722728:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722742:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 21 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.722749:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120822.722751:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120822.722759:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4800, rc 0) 00000100:00100000:2.0:1789120822.722846:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10656:x1876028901340288:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 2830us (3090us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789120822.722856:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:3.0:1789120822.729481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.729585:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901340416 00000100:00100000:2.0:1789120822.729595:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901340416 00000100:00100000:2.0:1789120822.729659:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:2.0:1789120822.729669:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10656:x1876028901340416:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789120822.729735:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729752:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729764:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729798:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729805:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729812:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729818:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120822.729823:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729831:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729859:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120822.729862:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120822.729867:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.729873:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa53ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.729961:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10656:x1876028901340416:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 294us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120822.729969:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:1.0:1789120822.732603:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.732732:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901340672 00000100:00100000:3.0:1789120822.732740:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901340672 00000100:00100000:3.0:1789120822.732816:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789120822.732825:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10656:x1876028901340672:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120822.733493:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:10656:x1876028901340672:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 665us (896us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789120822.733503:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789120822.763375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.763473:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901340928 00000100:00100000:0.0:1789120822.763483:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901340928 00000100:00100000:0.0:1789120822.763537:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:0.0:1789120822.763546:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:10187:x1876028901340928:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120822.763566:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120822.763585:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae77 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.763674:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.763688:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.763696:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.763728:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.763757:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 23 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.763770:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922334336:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120822.763859:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120822.765971:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922334336:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120822.765998:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.766397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.766629:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341056 00000100:00100000:2.0:1789120822.766637:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341056 00010000:00010000:2.0:1789120822.766676:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 24 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.766715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789120822.766724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:2350:x1876028901341056:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120822.766738:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120822.766746:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 24 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766757:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 24 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766779:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae70 expref: 24 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766813:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120822.766818:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766827:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766848:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.766873:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120822.766929:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.766934:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:2350:x1876028901341056:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 211us (537us total) trans 0 rc 0/0 00010000:00010000:0.0:1789120822.766937:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.766941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000004:00200000:0.0:1789120822.766956:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789120822.767955:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.767976:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 23 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.767984:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120822.767987:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789120822.767989:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a000, rc 0) 00000100:00100000:0.0:1789120822.768275:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:10187:x1876028901340928:12345-192.168.206.9@tcp:101:bash.0 Request processed in 4729us (4907us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789120822.768284:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:0.0:1789120822.772199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.772403:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341312 00000100:00100000:2.0:1789120822.772413:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341312 00000100:00100000:2.0:1789120822.772762:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:2.0:1789120822.772773:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:10187:x1876028901341312:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789120822.773074:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.773091:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120822.773103:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120822.773186:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789120822.773212:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008def5a81 reply state 00000000eb6d13c3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120822.773235:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789120822.773323:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789120822.773698:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10187:x1876028901341312:12345-192.168.206.9@tcp:36:bash.0 Request processed in 924us (1504us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789120822.773707:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00000020:00080000:2.0:1789120822.773713:0:5858:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789120822.776247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:1.0:1789120822.776918:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776944:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776952:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776958:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120822.776962:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776970:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776984:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120822.776986:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120822.776990:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120822.776996:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa53d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120822.777396:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341440 00000100:00100000:0.0:1789120822.777412:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341440 00000100:00100000:0.0:1789120822.777554:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:0.0:1789120822.777565:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:10187:x1876028901341440:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120822.777587:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120822.777603:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae7e expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.777656:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae7e expref: 27 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.777668:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae7e expref: 27 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120822.777686:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120822.777689:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120822.777692:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b400, rc 0) 00000100:00100000:0.0:1789120822.777746:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10187:x1876028901341440:12345-192.168.206.9@tcp:101:bash.0 Request processed in 184us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120822.777753:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:3.0:1789120822.780100:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.780171:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341568 00000100:00100000:3.0:1789120822.780180:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341568 00000100:00100000:3.0:1789120822.780239:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:3.0:1789120822.780247:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:10187:x1876028901341568:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120822.780265:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120822.780286:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae85 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120822.780311:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3d134, atime: 0x6aa3d133, ctime: 0x6aa3d134, blocks: 0xb 00010000:00010000:3.0:1789120822.780331:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=290s v=(0 0) 00010000:00010000:3.0:1789120822.780336:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120822.780344:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.780362:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.780377:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120822.780429:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:10187:x1876028901341568:12345-192.168.206.9@tcp:101:bash.0 Request processed in 182us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.780437:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:0.0:1789120822.783583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.783687:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341696 00000100:00100000:2.0:1789120822.783697:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341696 00002000:00010000:2.0:1789120822.783736:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789120822.783741:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdbfb6cf00 with x1876028901341696 ext(0->18446744073709551615) 00002000:00010000:2.0:1789120822.783751:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdbfb6cf00. 00000100:00100000:2.0:1789120822.783783:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:2.0:1789120822.783792:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901341696:12345-192.168.206.9@tcp:10:bash.0 00002000:00010000:2.0:1789120822.784086:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789120822.784090:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789120820 -> 1789120822 00002000:00010000:2.0:1789120822.784092:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789120819 -> 1789120819 00002000:00010000:2.0:1789120822.784094:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789120820 -> 1789120822 00002000:00010000:2.0:1789120822.784096:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789120822.784176:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901341696:12345-192.168.206.9@tcp:10:bash.0 Request processed in 384us (600us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789120822.784184:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00002000:00010000:2.0:1789120822.784188:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789120822.784190:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdbfb6cf00 with x1876028901341696 ext(0->18446744073709551615) 00002000:00010000:2.0:1789120822.784195:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdbfb6cf00. 00000100:00100000:3.0:1789120822.893807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120822.893979:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901341824 00000100:00100000:0.0:1789120822.893988:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901341824 00000100:00100000:2.0:1789120822.894125:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:2.0:1789120822.894187:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10670:x1876028901341824:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:3.0:1789120822.894387:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894405:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894416:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894440:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894466:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894474:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894733:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894741:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894748:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120822.894797:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894808:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894813:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894820:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894826:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120822.894829:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894842:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894854:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120822.894856:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120822.894861:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894867:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa53eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894878:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894883:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894888:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894905:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120822.894908:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894914:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894920:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cfe00) 00010000:00010000:3.0:1789120822.894922:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120822.894924:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894939:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa53f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894953:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894958:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894964:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894969:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120822.894972:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894977:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894984:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120822.894986:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120822.894989:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.894994:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa53f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.895086:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10670:x1876028901341824:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 901us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120822.895095:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:2.0:1789120822.977214:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.977279:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901342080 00000100:00100000:3.0:1789120822.977289:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901342080 00000100:00100000:3.0:1789120822.977352:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789120822.977361:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10673:x1876028901342080:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120822.977380:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120822.977399:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae8c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977464:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977491:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977503:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977518:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977526:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977532:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977870:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977880:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.977908:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120822.977919:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789120822.978029:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978038:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978045:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978051:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120822.978055:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978062:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978073:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120822.978076:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120822.978081:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978087:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978099:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978104:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978116:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978121:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120822.978123:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978130:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978137:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cfe00) 00010000:00010000:3.0:1789120822.978139:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120822.978187:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978194:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa540e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978234:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae8c expref: 30 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978250:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae8c expref: 29 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.978258:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120822.978261:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789120822.978264:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a400, rc 0) 00000100:00100000:3.0:1789120822.978330:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:10673:x1876028901342080:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 969us (1125us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789120822.978358:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:1.0:1789120822.983741:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120822.983830:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901342208 00000100:00100000:3.0:1789120822.983839:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901342208 00000100:00100000:3.0:1789120822.983914:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:3.0:1789120822.983925:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:10673:x1876028901342208:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789120822.984001:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.984273:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.984283:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.984331:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120822.984346:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 29 pid: 5859 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120822.984361:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59aa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922334464:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120822.984524:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120822.999637:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120822.999723:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901342464 00000100:00100000:2.0:1789120822.999732:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901342464 00000100:00100000:2.0:1789120822.999790:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:2.0:1789120822.999799:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:5589:x1876028901342464:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120823.000642:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:5589:x1876028901342464:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 839us (1009us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789120823.000653:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:3.0:1789120823.001765:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59aa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922334464:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120823.001792:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.003709:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120823.003800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901342592 00000100:00100000:1.0:1789120823.003809:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901342592 00010000:00010000:1.0:1789120823.003856:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 31 pid: 5859 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789120823.003944:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120823.003990:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:1.0:1789120823.004000:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:2349:x1876028901342592:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120823.004022:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120823.004035:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 31 pid: 5859 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004048:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 31 pid: 5859 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004069:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa53c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae77 expref: 31 pid: 5859 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004084:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120823.004089:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004098:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004106:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.004137:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120823.004226:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:2349:x1876028901342592:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 226us (524us total) trans 0 rc 0/0 00010000:00010000:0.0:1789120823.004709:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004719:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004759:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004766:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004772:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004778:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120823.004781:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004788:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004798:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120823.004800:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789120823.004804:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.004810:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.004855:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10673:x1876028901342208:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 20933us (21123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.004863:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:1.0:1789120823.004964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:2.0:1789120823.016976:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.017060:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901342848 00000100:00100000:0.0:1789120823.017069:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901342848 00000100:00100000:0.0:1789120823.017120:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789120823.017172:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:10673:x1876028901342848:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120823.017568:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10673:x1876028901342848:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 426us (598us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789120823.017577:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:0.0:1789120823.111524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.111838:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901343104 00000100:00100000:3.0:1789120823.111942:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901343104 00000100:00100000:3.0:1789120823.112127:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:3.0:1789120823.112139:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:10684:x1876028901343104:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789120823.112205:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.112226:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa542a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae93 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112324:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112339:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112350:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112366:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112373:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112380:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112687:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa543f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112698:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa543f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112705:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa543f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120823.112723:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789120823.112818:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112825:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112831:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112837:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120823.112841:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112848:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112873:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120823.112876:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120823.112881:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112888:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112910:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112917:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112934:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112938:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120823.112942:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112948:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112956:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cfe00) 00010000:00010000:3.0:1789120823.112959:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120823.112962:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.112968:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.113208:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa542a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae93 expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.113223:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa543f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae93 expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.113232:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.113234:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120823.113237:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a600, rc 0) 00000100:00100000:3.0:1789120823.113302:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:10684:x1876028901343104:12345-192.168.206.9@tcp:101:cat.0 Request processed in 1165us (1788us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789120823.113321:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:1.0:1789120823.122939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.123107:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901343360 00000100:00100000:0.0:1789120823.123117:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901343360 00000100:00100000:0.0:1789120823.123207:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:0.0:1789120823.123218:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:10684:x1876028901343360:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:0.0:1789120823.123472:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10684:x1876028901343360:12345-192.168.206.9@tcp:35:cat.0 Request processed in 255us (542us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789120823.123481:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:0.0:1789120823.160256:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.160345:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901343616 00000100:00100000:3.0:1789120823.160363:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901343616 00000100:00100000:3.0:1789120823.161293:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:3.0:1789120823.161309:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10685:x1876028901343616:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:2.0:1789120823.161503:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789120823.161536:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa543f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae93 expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161559:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae8c expref: 32 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161572:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa53dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae7e expref: 31 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161583:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.161595:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120823.161618:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161630:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161647:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161663:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161670:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.161676:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.162374:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.162387:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.162394:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120823.163014:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789120823.163024:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290416879445ns, next at 291416877020ns, rc = 0 00010000:00010000:2.0:1789120823.163088:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163099:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163108:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163126:0:5859:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163133:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163140:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163194:0:5859:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120823.163216:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163222:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163228:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163246:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.163252:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163260:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163271:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120823.163273:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3500) 00010000:00010000:2.0:1789120823.163281:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789120823.163289:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163290:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163336:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120823.163348:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163353:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa545b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163364:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163380:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163381:0:12067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ffd84cf3500) 00010000:00010000:0.0:1789120823.163393:0:12067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120823.163402:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163403:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163428:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163436:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.163439:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163446:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163456:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120823.163458:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.163461:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.163466:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa544d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120823.163476:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002b6fcf9e reply state 00000000a0752024 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.163484:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120823.163576:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:10685:x1876028901343616:12345-192.168.206.9@tcp:36:rm.0 Request processed in 2269us (3340us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789120823.163585:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00010000:00010000:0.0:1789120823.163704:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.163733:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120823.163735:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120823.163737:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120823.172769:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172789:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172796:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172803:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120823.172807:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172815:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172833:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd84cf3000) 00010000:00010000:0.0:1789120823.172837:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120823.172841:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.172848:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5454 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.244575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120823.244837:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901343872 00000100:00100000:1.0:1789120823.244846:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901343872 00000100:00100000:1.0:1789120823.245213:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:1.0:1789120823.245225:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:10691:x1876028901343872:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120823.245250:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120823.245283:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8ae9a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245419:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245433:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245444:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245458:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245464:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.245469:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120823.246286:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789120823.246466:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246478:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246487:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246518:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246536:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246542:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246548:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120823.246552:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246558:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246570:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:1.0:1789120823.246572:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120823.246577:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246583:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5470 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120823.246596:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000073c82be5 reply state 000000006a173bac transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120823.246605:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789120823.246633:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246645:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.246662:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:1.0:1789120823.246664:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120823.246666:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120823.246841:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:10691:x1876028901343872:12345-192.168.206.9@tcp:101:bash.0 Request processed in 1618us (2273us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789120823.246848:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00010000:00010000:0.0:1789120823.253402:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253418:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253426:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253432:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120823.253436:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253443:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253459:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd82a3f700) 00010000:00010000:0.0:1789120823.253462:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120823.253467:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.253473:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5477 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.256214:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.256825:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344000 00000100:00100000:3.0:1789120823.256841:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344000 00000100:00100000:3.0:1789120823.256988:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:3.0:1789120823.257000:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901344000:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120823.257022:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.257047:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aea1 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120823.257080:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120823.257106:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=290s v=(0 0) 00010000:00010000:3.0:1789120823.257112:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120823.257124:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.257201:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.257218:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ae00, rc 0) 00000100:00100000:3.0:1789120823.257331:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901344000:12345-192.168.206.9@tcp:101:bash.0 Request processed in 333us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.257366:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789120823.264720:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.264879:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344128 00000100:00100000:3.0:1789120823.264900:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344128 00000100:00100000:3.0:1789120823.264977:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:3.0:1789120823.264988:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:10691:x1876028901344128:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120823.265012:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.265036:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aea8 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.265077:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 9 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.265087:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120823.265092:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120823.265098:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.265140:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 9 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.265183:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 9 pid: 6707 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.265200:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59aa580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1876028922334592:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120823.265330:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120823.275347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.277883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344256 00000100:00100000:2.0:1789120823.277915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344256 00010000:00010000:2.0:1789120823.277993:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 10 pid: 6707 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.278074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:2.0:1789120823.278086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2349:x1876028901344256:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120823.278105:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120823.278139:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 10 pid: 6707 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.278209:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 10 pid: 6707 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.278244:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120823.278250:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120823.278262:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.278274:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.278325:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.278670:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1876028922334720:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789120823.278793:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431480 going to sleep for 11 seconds 00010000:00010000:3.0:1789120823.284771:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4664c8/0x13cfa3d77faa548c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea1 expref: 10 pid: 6707 timeout: 390 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.284806:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59aa580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1876028922334592:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120823.284853:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.285731:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:2.0:1789120823.286025:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:10691:x1876028901344128:12345-192.168.206.9@tcp:101:bash.0 Request processed in 21033us (21313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.286038:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789120823.289121:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5842:1876028922334720:192.168.206.9@tcp:105: 00010000:00010000:0.0:1789120823.289661:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120823.290101:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901344256:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 12013us (14763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.290117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:2.0:1789120823.294177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.294326:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344512 00000100:00100000:0.0:1789120823.294369:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344512 00000100:00100000:0.0:1789120823.294699:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:0.0:1789120823.294714:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:10691:x1876028901344512:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789120823.295823:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:10691:x1876028901344512:12345-192.168.206.9@tcp:35:bash.0 Request processed in 1104us (1673us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789120823.295839:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:1.0:1789120823.433925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.434050:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344640 00000100:00100000:0.0:1789120823.434062:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344640 00000100:00100000:0.0:1789120823.434125:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:0.0:1789120823.434136:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:10707:x1876028901344640:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120823.434198:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120823.434224:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa549a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aeaf expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434301:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434317:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434331:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120823.434405:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1789120823.434410:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120823.434437:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434734:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa549a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeaf expref: 36 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434784:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeaf expref: 35 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.434793:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120823.434797:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120823.434801:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4be00, rc 0) 00000100:00100000:0.0:1789120823.434883:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:10707:x1876028901344640:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 748us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.434901:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:1.0:1789120823.443087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.444753:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901344896 00000100:00100000:3.0:1789120823.444774:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901344896 00000100:00100000:3.0:1789120823.444961:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:3.0:1789120823.444973:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:10707:x1876028901344896:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120823.445003:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.445030:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa54a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aeb6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.445408:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa54af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.445427:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa54af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.445452:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa54af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120823.445682:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789120823.445861:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa54a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeb6 expref: 38 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.445921:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa54af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeb6 expref: 37 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.445931:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:3.0:1789120823.445935:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120823.445939:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a800, rc 0) 00000100:00100000:3.0:1789120823.447071:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:10707:x1876028901344896:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 2091us (3990us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789120823.447082:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:2.0:1789120823.451036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.451271:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345152 00000100:00100000:0.0:1789120823.451283:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345152 00000100:00100000:0.0:1789120823.451360:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:0.0:1789120823.451372:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:10707:x1876028901345152:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120823.451405:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120823.451432:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa54bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aebd expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.451584:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.451603:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.451616:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120823.451629:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789120823.451811:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa54bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aebd expref: 40 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.451831:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aebd expref: 39 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.451840:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:0.0:1789120823.451843:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789120823.451847:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120823.451937:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:10707:x1876028901345152:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 566us (915us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789120823.451946:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:1.0:1789120823.458565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.458749:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345280 00000100:00100000:0.0:1789120823.458764:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345280 00000100:00100000:0.0:1789120823.458835:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:0.0:1789120823.458847:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901345280:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:0.0:1789120823.458920:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.458945:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.458955:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120823.458960:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120823.458966:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.459010:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.459035:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 8 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.459054:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd906430c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922334848:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120823.459196:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120823.461629:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd906430c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922334848:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120823.461665:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120823.464316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120823.464393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.464921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345408 00000100:00100000:2.0:1789120823.464935:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345408 00000100:00100000:2.0:1789120823.465030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789120823.465042:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:2349:x1876028901345408:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120823.465062:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120823.465092:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa54af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeb6 expref: 39 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.465115:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:2.0:1789120823.465122:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120823.465238:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:2349:x1876028901345408:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 198us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.465247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789120823.465381:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345536 00000100:00100000:0.0:1789120823.465388:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345536 00002000:00100000:0.0:1789120823.465432:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ffdb998e940 x1876028901345536/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:354/0 lens 504/0 e 0 to 0 dl 1789120834 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120823.465457:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb998e940 with x1876028901345536 ext(0->8) 00010000:00010000:0.0:1789120823.465466:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 9 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.465482:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 9 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120823.465490:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdb998e940 00000100:00100000:0.0:1789120823.465516:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:0.0:1789120823.465524:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901345536:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:0.0:1789120823.466169:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901345536:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 615us (1745us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789120823.466180:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00002000:00100000:0.0:1789120823.466191:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ffdb998e940 x1876028901345536/t4294967302(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:354/0 lens 504/448 e 0 to 0 dl 1789120834 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120823.466200:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb998e940 with x1876028901345536 ext(0->8) 00010000:00010000:0.0:1789120823.466207:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.466222:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120823.466229:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdb998e940 00000100:00100000:1.0:1789120823.471375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.471648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345664 00000100:00100000:0.0:1789120823.471661:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345664 00010000:00010000:0.0:1789120823.471714:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.471797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789120823.471808:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901345664:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120823.471827:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789120823.471850:0:5842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789120823.471853:0:5842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789120823 00002000:00010000:0.0:1789120823.471856:0:5842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789120823 00002000:00010000:0.0:1789120823.471857:0:5842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789120823 00010000:00010000:0.0:1789120823.471882:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.471909:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.471945:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5493 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aea8 expref: 11 pid: 6706 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.471965:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120823.471971:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120823.471977:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.471989:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.472040:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120823.472108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2350:x1876028901345664:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 301us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.472117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00010000:00010000:3.0:1789120823.472260:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472272:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472301:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472311:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472319:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472326:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120823.472339:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472350:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472363:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.472371:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0042f/0x13cfa3d77faa54d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.472426:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901345280:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 13581us (13875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.472435:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:3.0:1789120823.475062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120823.475278:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901345920 00000100:00100000:1.0:1789120823.475290:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901345920 00000100:00100000:1.0:1789120823.475358:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:1.0:1789120823.475369:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:10707:x1876028901345920:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:1.0:1789120823.475784:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aebd expref: 38 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789120823.476350:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789120823.476405:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789120823.477245:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789120823.477321:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.477366:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.477376:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.477424:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120823.477457:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 42 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120823.477483:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb998da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922334976:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120823.477610:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd840bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120823.481416:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.481658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346048 00000100:00100000:3.0:1789120823.481669:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346048 00010000:00010000:3.0:1789120823.481722:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 43 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.481782:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789120823.481793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:2350:x1876028901346048:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120823.481812:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120823.481820:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 43 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.481858:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 43 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.481886:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:3.0:1789120823.481903:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.481914:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.481923:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.481947:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120823.482083:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:2350:x1876028901346048:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 291us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.482092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00010000:00010000:2.0:1789120823.483777:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa547e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae9a expref: 42 pid: 5857 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.483807:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb998da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922334976:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120823.483857:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.483869:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.483875:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120823.484309:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789120823.484775:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789120823.484932:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922335104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789120823.485092:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120823.485340:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120823.485384:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922335104 00000100:00100000:3.0:1789120823.485393:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922335104 00000100:00100000:3.0:1789120823.485656:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120823.485667:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5860:x1876028922335104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789120823.485774:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5860:x1876028922335104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.485783:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120823.485858:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922335104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789120823.486488:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789120823.486580:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922335232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789120823.486632:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120823.486657:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120823.486818:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922335232 00000100:00100000:3.0:1789120823.486825:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922335232 00000100:00100000:3.0:1789120823.486860:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120823.486869:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5860:x1876028922335232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789120823.487106:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5860:x1876028922335232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 237us (472us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789120823.487114:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789120823.487459:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922335232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789120823.487531:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789120823.487580:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487592:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487600:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487620:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.487625:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487633:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487651:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:2.0:1789120823.487654:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789120823.487660:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.487666:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa54d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120823.487876:0:5860:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789120823.488231:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789120823.488246:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290742101278ns, next at 291742098563ns, rc = 0 00000001:00080000:2.0:1789120823.488255:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789120823.488305:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd82a3f900) 00010000:00010000:2.0:1789120823.488308:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789120823.488317:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa54c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aebd expref: 46 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.488561:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+45:10707:x1876028901345920:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 13192us (13512us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789120823.488572:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000020:00080000:2.0:1789120823.488578:0:5860:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789120823.491667:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120823.491822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.491938:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346176 00000100:00100000:2.0:1789120823.491949:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346176 00000100:00100000:2.0:1789120823.492120:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:2.0:1789120823.492133:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+45:10707:x1876028901346176:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120823.492194:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120823.492228:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa54e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aec4 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.492303:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa54e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aec4 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.492319:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa54e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aec4 expref: 46 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.492339:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.492342:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120823.492348:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4000, rc 0) 00000100:00100000:2.0:1789120823.492417:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+46:10707:x1876028901346176:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 287us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.492424:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:3.0:1789120823.495937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.496055:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346432 00000100:00100000:0.0:1789120823.496068:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346432 00000100:00100000:0.0:1789120823.496137:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:0.0:1789120823.496182:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+46:10707:x1876028901346432:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120823.496872:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10707:x1876028901346432:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 689us (944us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789120823.496913:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00010000:00010000:1.0:1789120823.531410:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120823.583299:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.583431:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346560 00000100:00100000:2.0:1789120823.583444:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346560 00000100:00100000:2.0:1789120823.583534:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:2.0:1789120823.583547:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10718:x1876028901346560:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789120823.583650:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583672:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583715:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583735:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583743:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583750:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583871:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583880:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583887:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120823.583949:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583962:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583969:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583977:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.583995:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.583999:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584007:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584020:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120823.584023:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.584028:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584034:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa54e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584050:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584056:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584062:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584066:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.584069:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584075:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584092:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120823.584095:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.584098:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584105:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa54ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584122:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584128:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584133:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584139:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.584214:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584221:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584230:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.584233:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.584236:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.584243:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa54f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.584346:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10718:x1876028901346560:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 800us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.584356:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:1.0:1789120823.626484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.626604:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346816 00000100:00100000:3.0:1789120823.626618:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346816 00000100:00100000:3.0:1789120823.626701:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:3.0:1789120823.626712:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:10721:x1876028901346816:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120823.626739:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.626766:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa54fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aecb expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626854:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626871:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626884:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626913:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626921:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.626927:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627106:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627115:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627123:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120823.627135:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789120823.627297:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627305:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627313:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627319:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120823.627324:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627332:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627346:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120823.627349:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120823.627354:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627372:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627389:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627395:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627401:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627406:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120823.627409:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627415:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627423:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd831cfe00) 00010000:00010000:3.0:1789120823.627426:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120823.627429:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627435:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa550a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627480:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa54fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627493:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 49 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.627506:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.627508:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120823.627511:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a400, rc 0) 00000100:00100000:3.0:1789120823.627601:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10721:x1876028901346816:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 891us (1132us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789120823.627609:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:0.0:1789120823.632188:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.632310:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901346944 00000100:00100000:2.0:1789120823.632322:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901346944 00000100:00100000:2.0:1789120823.632402:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 103 00000100:00100000:2.0:1789120823.632414:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10721:x1876028901346944:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789120823.632515:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632538:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632552:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632585:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632592:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632600:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632606:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.632612:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632620:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632653:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.632657:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120823.632664:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.632672:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa551f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.632783:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10721:x1876028901346944:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 371us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.632792:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 103 00000100:00100000:0.0:1789120823.637590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.637714:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901347200 00000100:00100000:3.0:1789120823.637729:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901347200 00000100:00100000:3.0:1789120823.637804:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789120823.637816:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+49:10721:x1876028901347200:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120823.638185:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:10721:x1876028901347200:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 370us (611us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789120823.638194:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:1.0:1789120823.711125:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.711257:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901347456 00000100:00100000:3.0:1789120823.711270:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901347456 00000100:00100000:3.0:1789120823.711346:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:3.0:1789120823.711358:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:10731:x1876028901347456:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120823.711389:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.711392:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789120823.711429:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa54a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeaf expref: 50 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711450:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120823.711456:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120823.711472:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5526 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aed2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711610:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711626:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711635:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711678:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.711693:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 50 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.711708:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922335360:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120823.711828:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d307e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120823.714905:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922335360:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120823.714944:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120823.717042:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.717342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901347584 00000100:00100000:0.0:1789120823.717355:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901347584 00010000:00010000:0.0:1789120823.717412:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 51 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120823.717475:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:0.0:1789120823.717486:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:2350:x1876028901347584:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120823.717504:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120823.717512:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 51 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717526:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 51 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717553:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa5511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aecb expref: 51 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717571:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120823.717576:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717587:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717618:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.717657:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120823.717736:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:2350:x1876028901347584:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 250us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.717744:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00010000:00010000:2.0:1789120823.717941:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.717951:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120823.717975:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789120823.718213:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.718231:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 50 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.718240:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.718252:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789120823.718255:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a800, rc 0) 00000100:00100000:2.0:1789120823.718289:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:10731:x1876028901347456:12345-192.168.206.9@tcp:101:bash.0 Request processed in 6933us (7178us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789120823.718297:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:3.0:1789120823.720674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.720768:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901347840 00000100:00100000:2.0:1789120823.720780:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901347840 00000100:00100000:2.0:1789120823.720883:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 105 00000100:00100000:2.0:1789120823.720906:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:10731:x1876028901347840:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789120823.721275:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.721296:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.721312:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120823.721366:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789120823.721393:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b243fe52 reply state 000000005aceda32 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.721402:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120823.721524:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10731:x1876028901347840:12345-192.168.206.9@tcp:36:bash.0 Request processed in 620us (862us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789120823.721532:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 105 00000020:00080000:2.0:1789120823.721538:0:5859:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120823.725776:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.725863:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901347968 00000100:00100000:2.0:1789120823.725875:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901347968 00000100:00100000:2.0:1789120823.725960:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:2.0:1789120823.725981:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10731:x1876028901347968:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120823.726022:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120823.726048:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aed9 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726168:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726184:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726192:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726200:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726219:0:5857:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726248:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.726264:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.726280:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922335488:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120823.726389:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99600 going to sleep for 11 seconds 00010000:00010000:0.0:1789120823.726811:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726822:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726830:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726836:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120823.726840:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726848:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726865:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120823.726868:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120823.726871:0:3304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726881:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.726917:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa553b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120823.729949:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.730099:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348096 00000100:00100000:3.0:1789120823.730110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348096 00010000:00010000:3.0:1789120823.730189:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.730241:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:3.0:1789120823.730252:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:2350:x1876028901348096:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120823.730270:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120823.730296:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.730312:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 54 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.730341:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.730346:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.730357:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.730366:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.730389:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120823.730571:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:2350:x1876028901348096:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 209us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.730580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00010000:00010000:2.0:1789120823.732196:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa552d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed2 expref: 53 pid: 5858 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.732244:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922335488:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120823.732271:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.732282:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.732288:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120823.732346:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789120823.732351:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120823.732376:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.732415:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 53 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.732432:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 52 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.732442:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.732445:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120823.732449:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4200, rc 0) 00000100:00100000:2.0:1789120823.732731:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10731:x1876028901347968:12345-192.168.206.9@tcp:101:bash.0 Request processed in 6749us (6966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.732741:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 106 00000100:00100000:1.0:1789120823.735666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.735776:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348352 00000100:00100000:3.0:1789120823.735788:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348352 00000100:00100000:3.0:1789120823.735902:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:3.0:1789120823.735915:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:10731:x1876028901348352:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:3.0:1789120823.736254:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10731:x1876028901348352:12345-192.168.206.9@tcp:35:bash.0 Request processed in 342us (600us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789120823.736263:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789120823.787130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.787377:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348480 00000100:00100000:3.0:1789120823.787390:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348480 00000100:00100000:3.0:1789120823.787746:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:3.0:1789120823.787760:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+53:10737:x1876028901348480:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120823.787793:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.787821:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aee0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.787916:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.787933:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.787950:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120823.788036:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789120823.788041:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120823.788069:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.788098:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee0 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.788120:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee0 expref: 54 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.788129:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120823.788133:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120823.788137:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a600, rc 0) 00000100:00100000:3.0:1789120823.788445:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901348480:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 680us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.788585:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 107 00000100:00100000:1.0:1789120823.792027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.792187:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348608 00000100:00100000:2.0:1789120823.792200:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348608 00000100:00100000:2.0:1789120823.792270:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:2.0:1789120823.792280:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901348608:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120823.792305:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120823.792331:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa555e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aee7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792410:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792429:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792450:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792475:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792483:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792490:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792613:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792622:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792653:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120823.792694:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789120823.792699:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120823.792720:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792734:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792744:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792750:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792757:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792764:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.792769:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792776:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792788:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120823.792791:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.792796:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792815:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa5565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792832:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792838:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792844:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792849:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120823.792853:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792859:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792867:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120823.792869:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120823.792872:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792879:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa556c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792927:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa555e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792942:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.792956:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.792958:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120823.792961:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5c00, rc 0) 00000100:00100000:2.0:1789120823.793027:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10737:x1876028901348608:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 748us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.793036:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 108 00000100:00100000:0.0:1789120823.797656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.797880:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348864 00000100:00100000:2.0:1789120823.797901:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348864 00000100:00100000:2.0:1789120823.797978:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 109 00000100:00100000:2.0:1789120823.797989:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10737:x1876028901348864:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120823.798027:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120823.798053:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa557a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aeee expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798196:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798212:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798220:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798230:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798269:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 56 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.798300:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 56 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.798316:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922335616:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120823.800114:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.800135:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.800169:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922335744:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120823.800251:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120823.801227:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922335616:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120823.802455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.802548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901348992 00000100:00100000:3.0:1789120823.802560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901348992 00010000:00010000:3.0:1789120823.802610:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 57 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.802658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:3.0:1789120823.802670:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:2350:x1876028901348992:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120823.802686:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120823.802694:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 57 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.802708:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 57 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.802735:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee7 expref: 57 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.802756:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.802761:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.802771:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.802778:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120823.802843:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:2350:x1876028901348992:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 175us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.802871:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:1.0:1789120823.813948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.814049:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349120 00000100:00100000:3.0:1789120823.814061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349120 00010000:00010000:3.0:1789120823.814113:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120823.814200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:3.0:1789120823.814212:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:2350:x1876028901349120:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120823.814230:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120823.814239:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.814254:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 56 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.814281:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.814288:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.814299:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.814307:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.814328:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120823.814385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:2350:x1876028901349120:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.814414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00010000:00010000:2.0:1789120823.815106:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aed9 expref: 55 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120823.815128:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922335744:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120823.815203:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.815213:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.815219:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120823.815254:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789120823.815435:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa557a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 56 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.815594:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 55 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.815605:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120823.815608:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789120823.815612:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120823.815673:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10737:x1876028901348864:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 17685us (18031us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789120823.815682:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 109 00000100:00100000:1.0:1789120823.819269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120823.819402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349376 00000100:00100000:0.0:1789120823.819413:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349376 00000100:00100000:0.0:1789120823.819494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789120823.819504:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10737:x1876028901349376:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:0.0:1789120823.819524:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120823.819554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa54e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aec4 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120823.819575:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120823.819580:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120823.819639:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901349376:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 136us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.819647:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789120823.823411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120823.823717:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349504 00000100:00100000:2.0:1789120823.823729:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349504 00000100:00100000:2.0:1789120823.823803:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:2.0:1789120823.823814:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901349504:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:2.0:1789120823.823987:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.824008:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120823.824021:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120823.824295:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789120823.824422:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901349504:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 609us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.824432:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 110 00000100:00100000:1.0:1789120823.833856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120823.833965:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349632 00000100:00100000:3.0:1789120823.833978:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349632 00000100:00100000:3.0:1789120823.834118:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 111 00000100:00100000:3.0:1789120823.834130:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:10737:x1876028901349632:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120823.834309:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120823.834339:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aef5 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834412:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834507:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834531:0:8217:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834547:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834562:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120823.834566:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120823.834569:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120823.834578:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390b600, rc 0) 00000100:00100000:3.0:1789120823.834714:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10737:x1876028901349632:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 586us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.834721:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 111 00000040:00080000:3.0:1789120824.234579:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120824.234593:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120824.234650:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789120824.234658:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120824.234830:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922335872:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789120824.234990:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d307e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120824.241646:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922335872:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120824.245935:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120824.247344:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349760 00000100:00100000:1.0:1789120824.247369:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349760 00000100:00100000:1.0:1789120824.247589:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:1.0:1789120824.247602:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10738:x1876028901349760:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120824.247658:0:5857:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120824.248072:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10738:x1876028901349760:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 471us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120824.248082:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 112 00000100:00100000:1.0:1789120824.253060:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.253210:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901349888 00000100:00100000:2.0:1789120824.253222:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901349888 00000100:00100000:2.0:1789120824.253285:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:2.0:1789120824.253295:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10738:x1876028901349888:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789120824.253751:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.253773:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.253787:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255531:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255554:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255566:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255601:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255611:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255618:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120824.255675:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789120824.255680:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120824.255693:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255705:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255711:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255718:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255724:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120824.255728:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255734:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255746:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:2.0:1789120824.255749:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120824.255753:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255758:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa559d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255773:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255789:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255795:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255800:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120824.255802:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255808:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255816:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120824.255819:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120824.255821:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255827:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255843:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255849:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255854:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255859:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120824.255869:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255875:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255882:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120824.255899:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120824.255902:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.255908:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.256100:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10738:x1876028901349888:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 2703us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.256114:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 113 00000100:00100000:0.0:1789120824.260781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120824.260918:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901350144 00000100:00100000:1.0:1789120824.260932:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901350144 00000100:00100000:1.0:1789120824.261063:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:1.0:1789120824.261076:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:10738:x1876028901350144:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120824.261104:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120824.261129:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa55b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aefc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261303:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261321:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261334:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120824.261348:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789120824.261479:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261502:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261509:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261515:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120824.261520:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261528:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261542:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120824.261546:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120824.261552:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261559:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261608:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa55b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aefc expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261619:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:1.0:1789120824.261622:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120824.261626:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa55b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aefc expref: 57 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.261635:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120824.261712:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350144:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 638us (946us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789120824.261720:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:0.0:1789120824.264794:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.264876:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901350272 00000100:00100000:3.0:1789120824.264895:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901350272 00000100:00100000:3.0:1789120824.264957:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:3.0:1789120824.264967:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350272:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789120824.265022:0:8217:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789120824.265199:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350272:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 232us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.265209:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:0.0:1789120824.269255:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.269361:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901350528 00000100:00100000:2.0:1789120824.269374:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901350528 00000100:00100000:2.0:1789120824.269438:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:2.0:1789120824.269449:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350528:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120824.269475:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120824.269478:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120824.269510:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aee0 expref: 56 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.269532:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:2.0:1789120824.269537:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120824.269553:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af03 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120824.270084:0:5858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789120824.270365:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.270382:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.270392:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.270451:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa55c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af03 expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.270468:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af03 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.270477:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120824.270479:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120824.270482:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4400, rc 0) 00000100:00100000:2.0:1789120824.270561:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10738:x1876028901350528:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1113us (1318us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789120824.270570:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:0.0:1789120824.274503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.274627:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901350784 00000100:00100000:3.0:1789120824.274639:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901350784 00000100:00100000:3.0:1789120824.274711:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:3.0:1789120824.274723:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10738:x1876028901350784:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789120824.274792:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120824.274826:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa55ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af03 expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.274868:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:3.0:1789120824.274882:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120824.274946:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.274961:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.274973:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.274987:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.274993:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275009:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275095:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275102:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275110:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275116:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120824.275121:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275135:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275177:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:3.0:1789120824.275180:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120824.275185:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275191:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa55dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275201:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275207:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275213:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275223:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120824.275225:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275231:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275237:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1f1029e2 (ffff9ffd831cfe00) 00010000:00010000:3.0:1789120824.275239:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120824.275242:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.275256:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa55e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f1029e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.275347:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350784:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 625us (857us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789120824.275355:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:0.0:1789120824.277801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.277903:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901350912 00000100:00100000:2.0:1789120824.277915:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901350912 00000100:00100000:2.0:1789120824.277988:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789120824.278000:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:10738:x1876028901350912:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120824.278025:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120824.278075:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa55ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af0a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278118:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278134:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278191:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278314:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa55ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278335:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.278343:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:2.0:1789120824.278347:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120824.278350:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5c00, rc 0) 00000100:00100000:2.0:1789120824.278412:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10738:x1876028901350912:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 413us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.278420:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:0.0:1789120824.282089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.282238:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901351168 00000100:00100000:3.0:1789120824.282250:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901351168 00000100:00100000:3.0:1789120824.282319:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:3.0:1789120824.282330:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:10738:x1876028901351168:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789120824.282448:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.282468:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.282482:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120824.282782:0:8217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789120824.282793:0:8217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291536649091ns, next at 292536646131ns, rc = 0 00000004:00010000:3.0:1789120824.282900:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000055376890 reply state 00000000faa8425a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.282911:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120824.283051:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10738:x1876028901351168:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 720us (974us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789120824.283059:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00010000:00010000:1.0:1789120824.288641:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288661:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288670:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288677:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120824.288682:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288691:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288709:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:1.0:1789120824.288713:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120824.288718:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.288725:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a400/0x13cfa3d77faa55f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.291057:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120824.291193:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901351296 00000100:00100000:1.0:1789120824.291205:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901351296 00000100:00100000:1.0:1789120824.291267:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:1.0:1789120824.291277:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:10738:x1876028901351296:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120824.291313:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120824.291348:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af11 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.291420:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.291451:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.291480:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:1.0:1789120824.291483:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120824.291488:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb000, rc 0) 00000100:00100000:1.0:1789120824.291555:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10738:x1876028901351296:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 279us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120824.291563:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 120 00000100:00100000:0.0:1789120824.296057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.300179:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901351424 00000100:00100000:3.0:1789120824.300200:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901351424 00000100:00100000:2.0:1789120824.300707:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:2.0:1789120824.300720:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901351424:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789120824.301178:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901351424:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 459us (5134us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789120824.301205:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00080000:0.0:1789120824.301861:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120824.308688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.308764:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901351680 00000100:00100000:3.0:1789120824.308777:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901351680 00000100:00100000:3.0:1789120824.308849:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:3.0:1789120824.308861:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:10738:x1876028901351680:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789120824.309802:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:10738:x1876028901351680:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 936us (1120us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789120824.309815:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:1.0:1789120824.312673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.312781:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901351936 00000100:00100000:3.0:1789120824.312794:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901351936 00000100:00100000:3.0:1789120824.312869:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:3.0:1789120824.312881:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:10738:x1876028901351936:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120824.313187:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:10738:x1876028901351936:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 308us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.313195:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:2.0:1789120824.315656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120824.315799:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352064 00000100:00100000:1.0:1789120824.315811:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352064 00000100:00100000:1.0:1789120824.315879:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:1.0:1789120824.315900:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:10738:x1876028901352064:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120824.315928:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120824.315954:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af18 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316043:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316080:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316094:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120824.316181:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120824.316200:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316229:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af18 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316248:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af18 expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.316258:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:1.0:1789120824.316262:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789120824.316265:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb400, rc 0) 00000100:00100000:1.0:1789120824.316329:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:10738:x1876028901352064:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 432us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120824.316336:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 122 00000100:00100000:0.0:1789120824.322866:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.324753:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352192 00000100:00100000:3.0:1789120824.324771:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352192 00000100:00100000:3.0:1789120824.324857:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:3.0:1789120824.324869:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb95052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901352192:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120824.324906:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120824.324934:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af1f expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120824.324971:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d138, blocks: 0x1 00010000:00010000:3.0:1789120824.325065:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:3.0:1789120824.325089:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120824.325102:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 10 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.325126:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 10 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.325162:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ae00, rc 0) 00000100:00100000:3.0:1789120824.325236:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb95052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2349:x1876028901352192:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 370us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.325244:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:0.0:1789120824.328042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.328194:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352448 00000100:00100000:3.0:1789120824.328206:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352448 00000100:00100000:3.0:1789120824.328285:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:3.0:1789120824.328295:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:10738:x1876028901352448:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120824.328423:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:10738:x1876028901352448:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.328431:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 123 00000100:00100000:2.0:1789120824.330918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120824.331135:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352576 00000100:00100000:0.0:1789120824.331177:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352576 00000100:00100000:0.0:1789120824.331245:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789120824.331256:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:10738:x1876028901352576:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120824.331280:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120824.331303:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af26 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.331425:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.331498:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120824.331504:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120824.331512:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.331562:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.331578:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.331601:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922336000:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120824.331856:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120824.335289:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922336000:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120824.335335:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.335363:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:2.0:1789120824.335598:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:10738:x1876028901352576:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 4343us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.335608:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:0.0:1789120824.336969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.337695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352704 00000100:00100000:3.0:1789120824.337708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352704 00010000:00010000:2.0:1789120824.337858:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.337952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:2.0:1789120824.337963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2349:x1876028901352704:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120824.337981:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120824.338010:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.338025:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.338053:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5614 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af1f expref: 11 pid: 6707 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.338090:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120824.338095:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120824.338106:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.338118:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.338207:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.338224:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922336128:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789120824.338470:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120824.342077:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922336128:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789120824.342093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:2.0:1789120824.342111:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120824.342203:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2349:x1876028901352704:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 4239us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.342218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:0.0:1789120824.342646:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352832 00000100:00100000:0.0:1789120824.342655:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352832 00002000:00100000:0.0:1789120824.342709:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ffdb58fad00 x1876028901352832/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:355/0 lens 504/0 e 0 to 0 dl 1789120835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120824.342720:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb58fad00 with x1876028901352832 ext(0->12) 00002000:00010000:0.0:1789120824.342726:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb58fad00 00000100:00100000:0.0:1789120824.342758:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789120824.342769:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2349:x1876028901352832:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789120824.345004:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:2349:x1876028901352832:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 2226us (2903us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789120824.345137:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00002000:00100000:0.0:1789120824.345245:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ffdb58fad00 x1876028901352832/t4294967308(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:355/0 lens 504/448 e 0 to 0 dl 1789120835 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120824.345257:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb58fad00 with x1876028901352832 ext(0->12) 00002000:00010000:0.0:1789120824.345264:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb58fad00 00000100:00100000:1.0:1789120824.347547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.351944:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901352960 00000100:00100000:2.0:1789120824.351958:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901352960 00000100:00100000:2.0:1789120824.352177:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 124 00000100:00100000:2.0:1789120824.352189:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:10738:x1876028901352960:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789120824.465989:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:10738:x1876028901352960:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 113794us (118442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.466001:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 124 00000001:00080000:2.0:1789120824.466625:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967389 is committed 00000001:00080000:2.0:1789120824.466653:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:2.0:1789120824.466677:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:2.0:1789120824.466691:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789120824.466711:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffc82e99180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789120824.466716:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffda0309a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc82e999c0 00000020:00080000:2.0:1789120824.466719:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffda0309900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb998a400 00000004:00080000:2.0:1789120824.466732:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789120824.466754:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1789120824.466758:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789120824.466781:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffd83f6dd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789120824.466784:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb57f5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffd83f6d300 00000020:00080000:2.0:1789120824.466786:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb57f5600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffd955a9800 00000020:00080000:2.0:1789120824.466791:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789120824.466957:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120824.466970:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb58f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922336256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789120824.467196:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120824.467253:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb58fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922336384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789120824.467317:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922336256 00000100:00100000:2.0:1789120824.467323:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922336256 00000100:00100000:2.0:1789120824.467366:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120824.467373:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922336256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789120824.467394:0:6707:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789120824.467415:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.467444:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.467453:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789120824.467457:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120824.467462:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.467497:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.467510:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 11 pid: 6706 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.467522:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922336512:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120824.467567:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431480 going to sleep for 11 seconds 00000100:00080000:2.0:1789120824.467577:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120824.467698:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120824.467842:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120824.467851:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922336640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789120824.467877:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120824.467989:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922336384 00000100:00100000:2.0:1789120824.467993:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922336384 00000100:00100000:2.0:1789120824.468026:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922336640 00000100:00100000:2.0:1789120824.468029:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922336640 00000100:00100000:2.0:1789120824.468044:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120824.468050:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1876028922336384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789120824.468219:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789120824.468223:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789120824 00002000:00010000:2.0:1789120824.468225:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789120824.468227:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789120824 -> 1789120824 00002000:00010000:2.0:1789120824.468229:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789120824.468437:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922336384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 378us (731us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789120824.468445:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120824.468461:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789120824.468468:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922336640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789120824.468495:0:6706:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1789120824.468519:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3d137, atime: 0x6aa3d137, ctime: 0x6aa3d137, blocks: 0x1 00010000:00010000:2.0:1789120824.468525:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.468536:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=291s v=(0 0) 00010000:00010000:2.0:1789120824.468539:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120824.468545:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.468559:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.468566:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.468572:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.468629:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789120824.469181:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb9506940/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789120824.469188:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9506940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922336640:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789120824.469199:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb58fa580/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789120824.469203:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb58fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922336384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789120824.469278:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3319:x1876028922336640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 585us (1174us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789120824.469287:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:00080000:3.0:1789120824.469458:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789120824.469598:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1789120824.472026:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120824.472103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.472208:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120824.472213:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.472224:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.472245:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.472253:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa5629 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.473700:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120824.473705:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120824.473707:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120824.473760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.475311:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922336512:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120824.475354:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.475522:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.477728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353216 00000100:00100000:3.0:1789120824.477738:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353216 00010000:00010000:3.0:1789120824.477779:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 12 pid: 6706 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.477834:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:3.0:1789120824.477842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:2350:x1876028901353216:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120824.477855:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120824.477860:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 12 pid: 6706 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.477872:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 12 pid: 6706 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.477902:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa53e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae85 expref: 12 pid: 6706 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.477918:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120824.477922:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120824.477926:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.477935:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.477972:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120824.478180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901353216:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 338us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.478189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00010000:00010000:3.0:1789120824.478218:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.478228:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.478236:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.478243:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.478256:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789120824.478532:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120824.478539:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.478548:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120824.478552:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.478560:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.478576:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.478584:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.478602:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120824.478604:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120824.478605:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120824.479912:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1876028922336256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12533us (12711us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789120824.479923:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120824.479947:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353088 00000100:00100000:3.0:1789120824.479953:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353088 00000004:00080000:0.0:1789120824.480080:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb58f9a40/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789120824.480086:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb58f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922336256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789120824.482329:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789120824.482719:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901353088:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789120824.530356:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901353088:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 47994us (56590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.530370:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000001:00080000:3.0:1789120824.530532:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1789120824.530548:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789120824.530562:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1789120824.541565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.541733:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353472 00000100:00100000:3.0:1789120824.541756:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353472 00000100:00100000:3.0:1789120824.541864:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 125 00000100:00100000:3.0:1789120824.541875:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10738:x1876028901353472:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789120824.541935:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120824.541961:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa560d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af18 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.541979:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:3.0:1789120824.541984:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120824.542014:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.542027:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.542222:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120824.542455:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006ed1587b reply state 000000001397c160 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.542465:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120824.542560:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:10738:x1876028901353472:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 686us (1003us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789120824.542568:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 125 00010000:00010000:0.0:1789120824.548981:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549018:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549026:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549032:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120824.549037:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549045:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549062:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:0.0:1789120824.549065:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120824.549069:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.549075:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5630 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.550482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.550564:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353600 00000100:00100000:2.0:1789120824.550573:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353600 00000100:00100000:2.0:1789120824.550631:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789120824.550641:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901353600:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789120824.550898:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789120824.550902:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789120824 -> 1789120823 00002000:00010000:2.0:1789120824.550904:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789120823 00002000:00010000:2.0:1789120824.550906:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789120824 -> 1789120823 00002000:00010000:2.0:1789120824.550909:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789120824.550969:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901353600:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 328us (494us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789120824.550977:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00010000:00010000:1.0:1789120824.554444:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120824.560340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.560490:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353856 00000100:00100000:2.0:1789120824.560500:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353856 00000100:00100000:2.0:1789120824.560556:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:2.0:1789120824.560565:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:10738:x1876028901353856:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789120824.560630:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.560645:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.560673:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.560709:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.560723:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 15 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.560737:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922336768:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120824.560863:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3001780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120824.568460:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120824.568549:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901353984 00000100:00100000:0.0:1789120824.568557:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901353984 00010000:00010000:0.0:1789120824.568595:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 16 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.568635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:0.0:1789120824.568644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:2350:x1876028901353984:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120824.568673:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120824.568680:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 16 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.568693:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 16 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.568714:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:0.0:1789120824.568718:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.568733:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.568741:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.568759:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120824.568900:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa55f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af0a expref: 16 pid: 5858 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.568916:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922336768:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120824.568934:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.568954:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.568960:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.568985:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.568992:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.569005:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.569011:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120824.569016:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.569023:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.569031:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:2.0:1789120824.569034:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789120824.569038:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.569045:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.569232:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:2350:x1876028901353984:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 588us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120824.569241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789120824.571103:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10738:x1876028901353856:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 10528us (10762us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789120824.571117:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 126 00000100:00100000:0.0:1789120824.580789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.580879:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901354112 00000100:00100000:3.0:1789120824.580898:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901354112 00000100:00100000:3.0:1789120824.580957:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:3.0:1789120824.580966:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901354112:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789120824.581030:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.581049:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.581058:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120824.581062:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120824.581067:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.581100:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.581114:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 7 pid: 6705 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.581128:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1876028922336896:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120824.581245:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120824.589565:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8216:1876028922336896:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120824.589591:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.592805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.592904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901354240 00000100:00100000:2.0:1789120824.592916:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901354240 00010000:00010000:2.0:1789120824.592956:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 8 pid: 6705 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.592997:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:2.0:1789120824.593007:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901354240:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120824.593040:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120824.593062:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 8 pid: 6705 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.593076:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 8 pid: 6705 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.593098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6d0042f/0x13cfa3d77faa561b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af26 expref: 8 pid: 6705 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.593114:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120824.593119:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120824.593124:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.593133:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.593215:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120824.593264:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901354240:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 258us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.593272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00010000:00010000:1.0:1789120824.593463:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593478:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593515:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593522:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593529:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593535:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120824.593539:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593547:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593560:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.593567:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa563e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120824.593624:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2351:x1876028901354112:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 12658us (12843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120824.593632:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:0.0:1789120824.598074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.598192:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901354496 00000100:00100000:2.0:1789120824.598202:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901354496 00000100:00100000:2.0:1789120824.598260:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 127 00000100:00100000:2.0:1789120824.598270:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10738:x1876028901354496:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789120824.598354:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598370:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598383:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598600:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598612:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598620:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598652:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.598666:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 15 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.598678:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922337024:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120824.598760:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3001780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120824.602702:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922337024:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120824.602734:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.610214:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.610313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901354624 00000100:00100000:2.0:1789120824.610323:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901354624 00010000:00010000:2.0:1789120824.610373:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 16 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.610413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:2.0:1789120824.610423:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:2350:x1876028901354624:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120824.610448:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120824.610456:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 16 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610469:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 16 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa55ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af11 expref: 16 pid: 5857 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:2.0:1789120824.610514:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610524:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610532:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.610559:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120824.610615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:2350:x1876028901354624:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 194us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.610624:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00010000:00010000:3.0:1789120824.614049:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.614084:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120824.614312:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789120824.614748:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789120824.614805:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789120824.614908:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5859:1876028922337152:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789120824.614972:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120824.615045:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120824.618629:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922337152 00000100:00100000:2.0:1789120824.618642:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922337152 00000100:00100000:2.0:1789120824.618699:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789120824.618709:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1876028922337152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789120824.618945:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5859:x1876028922337152:12345-0@lo:1000:mdt00_002.0 Request processed in 237us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.618954:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120824.619006:0:5859:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789120824.619012:0:5859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1789120824.619029:0:5859:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb58fa580, transno 4294967309 00000004:00080000:3.0:1789120824.619077:0:5859:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb58f9a40, transno 4294967310 00000100:00100000:3.0:1789120824.623133:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5859:1876028922337152:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789120824.627245:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789120824.627328:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5859:1876028922337280:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789120824.627390:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120824.627546:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd83f6d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120824.631367:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922337280 00000100:00100000:1.0:1789120824.631381:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922337280 00000100:00100000:0.0:1789120824.632094:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120824.632105:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5859:x1876028922337280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789120824.632403:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5859:x1876028922337280:12345-0@lo:1000:mdt00_002.0 Request processed in 300us (5012us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789120824.632423:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120824.632577:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5859:1876028922337280:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789120824.632622:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632632:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632640:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632657:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120824.632661:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632669:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632684:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd84cf3800) 00010000:00010000:3.0:1789120824.632687:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120824.632692:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632699:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa564c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632730:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632737:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632742:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632747:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120824.632750:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632756:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632776:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120824.632778:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120824.632785:0:5859:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632796:0:5859:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632805:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.632836:0:5859:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.632850:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922337408:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789120824.632927:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120824.636008:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120824.642729:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922337408:192.168.206.9@tcp:105: 00010000:00010000:1.0:1789120824.642760:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642771:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa558f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642809:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642822:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642832:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642843:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642849:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642855:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642860:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120824.642864:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642872:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642915:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120824.642918:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120824.642922:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642928:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5653 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642938:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642945:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642950:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642955:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120824.642957:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642963:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642969:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120824.642972:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120824.642974:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120824.642980:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120824.643238:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10738:x1876028901354496:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 44968us (45173us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789120824.643248:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 127 00000020:00080000:1.0:1789120824.643254:0:5859:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789120824.643405:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901354752 00000100:00100000:1.0:1789120824.643412:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901354752 00000100:00100000:1.0:1789120824.643457:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789120824.643465:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10737:x1876028901354752:12345-192.168.206.9@tcp:49:lfs.0 00000100:00100000:1.0:1789120824.643560:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10737:x1876028901354752:12345-192.168.206.9@tcp:49:lfs.0 Request processed in 95us (7560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120824.643567:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000040:00080000:3.0:1789120824.644012:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120824.644017:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120824.644578:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789120824.644586:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120824.648244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120824.648338:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355008 00000100:00100000:2.0:1789120824.648347:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355008 00000100:00100000:2.0:1789120824.648417:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:2.0:1789120824.648426:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10737:x1876028901355008:12345-192.168.206.9@tcp:58:lfs.0 00000040:00080000:2.0:1789120824.648766:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789120824.648851:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10737:x1876028901355008:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 425us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120824.648860:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 128 00000100:00100000:1.0:1789120824.658624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120824.658728:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355264 00000100:00100000:0.0:1789120824.658737:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355264 00000100:00100000:0.0:1789120824.658792:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789120824.658802:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd8faf4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:10738:x1876028901355264:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789120824.659538:0:5861:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789120824.659644:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789120824.659690:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659707:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659717:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659725:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659731:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659737:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.659751:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789120824.659843:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd8faf4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:10738:x1876028901355264:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1042us (1227us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789120824.659853:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000020:00080000:0.0:1789120824.659866:0:5861:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789120824.660330:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120824.660338:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.660347:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120824.660351:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.660358:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.660383:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:2.0:1789120824.660386:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120824.660391:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.660397:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa565a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120824.660414:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120824.660415:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120824.660417:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120824.696049:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120824.696415:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355392 00000100:00100000:0.0:1789120824.696428:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355392 00000100:00100000:0.0:1789120824.696508:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 129 00000100:00100000:0.0:1789120824.696520:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:10740:x1876028901355392:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120824.696552:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120824.696578:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af2d expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696656:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696675:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696688:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696706:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696714:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.696720:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.697120:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.697132:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 21 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.697209:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.697254:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 21 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.697271:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 21 pid: 5859 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120824.697288:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922337536:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120824.697405:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120824.702341:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922337536:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120824.702384:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120824.704796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120824.707622:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355648 00000100:00100000:0.0:1789120824.707645:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355648 00000100:00100000:0.0:1789120824.707744:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:0.0:1789120824.707757:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:5589:x1876028901355648:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789120824.708095:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:5589:x1876028901355648:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 339us (3313us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789120824.708105:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789120824.714589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120824.714695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355776 00000100:00100000:3.0:1789120824.714707:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355776 00010000:00010000:3.0:1789120824.714762:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 23 pid: 5859 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120824.714843:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:3.0:1789120824.714854:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:2349:x1876028901355776:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120824.714874:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120824.714894:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 23 pid: 5859 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.714910:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 23 pid: 5859 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.714937:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5581 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aeee expref: 23 pid: 5859 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.714957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120824.714964:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.714976:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.714985:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120824.715898:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120824.715984:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:2349:x1876028901355776:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 1128us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120824.716003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00010000:00010000:0.0:1789120824.722682:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722705:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120824.722792:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789120824.722798:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120824.722824:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722843:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722854:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722861:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722870:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722876:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4be00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120824.722894:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722903:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722921:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120824.722924:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120824.722931:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722937:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5668 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722970:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722976:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722983:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722988:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120824.722991:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.722998:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.723005:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120824.723008:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120824.723011:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.723016:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa566f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.723069:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af2d expref: 22 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.723084:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af2d expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120824.723711:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120824.723713:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120824.723716:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a600, rc 0) 00000100:00100000:0.0:1789120824.723944:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10740:x1876028901355392:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 27421us (27905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120824.723954:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 129 00000001:00080000:0.0:1789120825.166440:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1789120825.166467:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1789120825.166478:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:3.0:1789120825.578440:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789120825.586131:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120825.586620:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb58fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922337664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120825.586719:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120825.586870:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922337664 00000100:00100000:0.0:1789120825.586891:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922337664 00000100:00100000:0.0:1789120825.586965:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120825.586976:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922337664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120825.587006:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789120825.594969:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922337664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7981us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120825.594987:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789120825.595536:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb58fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922337664:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789120825.684331:0:12456:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120825.684343:0:12456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120825.684387:0:12456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789120825.684394:0:12456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789120825.706461:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120825.706474:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120825.706519:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789120825.706527:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120825.706682:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922337792:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789120825.706812:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120825.713484:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922337792:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120825.716779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120825.718649:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901355904 00000100:00100000:2.0:1789120825.718666:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901355904 00000100:00100000:2.0:1789120825.718781:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00100000:2.0:1789120825.718795:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10752:x1876028901355904:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120825.718841:0:5857:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120825.719007:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10752:x1876028901355904:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 214us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120825.719016:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 130 00000100:00080000:0.0:1789120825.720348:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120825.738748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120825.738869:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901356160 00000100:00100000:3.0:1789120825.738893:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901356160 00000100:00100000:3.0:1789120825.739106:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 131 00000100:00100000:3.0:1789120825.739119:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:10752:x1876028901356160:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120825.739331:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120825.739362:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa567d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af34 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120825.739576:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120825.739595:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120825.739608:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120825.739622:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789120825.739790:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa567d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af34 expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120825.739835:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af34 expref: 23 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120825.739844:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:3.0:1789120825.739847:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120825.739851:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ae00, rc 0) 00000100:00100000:3.0:1789120825.740126:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:10752:x1876028901356160:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1008us (1392us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789120825.740137:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 131 00000100:00100000:0.0:1789120825.750514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120825.750657:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901356416 00000100:00100000:1.0:1789120825.750670:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901356416 00000100:00100000:1.0:1789120825.750744:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00100000:1.0:1789120825.750756:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:10752:x1876028901356416:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789120825.750858:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.750893:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.750909:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751226:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751236:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751243:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751251:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120825.751256:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751264:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751280:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:1.0:1789120825.751284:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120825.751290:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120825.751296:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5692 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120825.751491:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:10752:x1876028901356416:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 735us (986us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789120825.751502:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 132 00000100:00100000:3.0:1789120825.753543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000040:00080000:0.0:1789120825.753833:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120825.753839:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120825.755541:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789120825.755574:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120825.755669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901356544 00000100:00100000:0.0:1789120825.755682:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901356544 00000100:00100000:0.0:1789120825.755773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789120825.755785:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:2350:x1876028901356544:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120825.755804:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120825.755836:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af34 expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120825.755856:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120825.755862:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120825.755951:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:2350:x1876028901356544:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 168us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120825.755960:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:1.0:1789120825.759863:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120825.765088:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901356800 00000100:00100000:0.0:1789120825.765105:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901356800 00000100:00100000:0.0:1789120825.767340:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:0.0:1789120825.767366:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:10752:x1876028901356800:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789120825.767744:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:10752:x1876028901356800:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 389us (7895us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789120825.767753:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00010000:00010000:1.0:1789120826.605200:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120827.114430:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922337920:0@lo:400:kworker.0 00000100:00100000:0.0:1789120827.114502:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120827.114672:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120827.114703:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120827.114758:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338048 00000100:00100000:2.0:1789120827.114765:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338048 00000100:00100000:2.0:1789120827.114819:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789120827.114828:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922338048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120827.114887:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120827.114930:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922338048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120827.114937:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789120827.114959:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120827.114984:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789120827.114990:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1789120827.115010:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffd9d075680, transno 4294967301 00000004:00080000:2.0:1789120827.115019:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789120827.115028:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb9506940, transno 4294967304 00000100:00100000:2.0:1789120827.115039:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120827.115604:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922338176:0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.115638:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120827.115671:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338176 00000100:00100000:2.0:1789120827.115675:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338176 00000100:00100000:2.0:1789120827.115705:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120827.115712:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922338176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.115748:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922338176:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120827.115756:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120827.115801:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922338176:0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.115832:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922338304:0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.115882:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120827.115915:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338304 00000100:00100000:2.0:1789120827.115919:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338304 00000100:00100000:2.0:1789120827.115959:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789120827.115966:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922338304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.116003:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922338304:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120827.116009:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789120827.116027:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120827.116045:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d075680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922338304:0@lo:400:kworker.0 00000100:00100000:0.0:1789120827.116391:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922337920 00000100:00100000:0.0:1789120827.116396:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922337920 00000100:00100000:0.0:1789120827.116521:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789120827.116530:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120827.116582:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922337920:12345-0@lo:400:kworker.0 Request processed in 53us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120827.116589:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789120827.116721:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120827.116731:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922338560:0@lo:400:kworker.0 00000100:00100000:0.0:1789120827.117004:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd9d074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922338432:0@lo:400:kworker.0 00000100:00100000:0.0:1789120827.117038:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120827.117115:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922337920:0@lo:400:kworker.0 00000100:00100000:2.0:1789120827.117280:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120827.117348:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338560 00000100:00100000:0.0:1789120827.117353:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338560 00000100:00100000:0.0:1789120827.117396:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789120827.117403:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922338560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789120827.117496:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120827.117550:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922338560:12345-0@lo:400:kworker.0 Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120827.117558:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789120827.117614:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922338560:0@lo:400:kworker.0 00000100:00100000:3.0:1789120827.117667:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338432 00000100:00100000:3.0:1789120827.117671:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338432 00000100:00100000:3.0:1789120827.117752:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789120827.117760:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922338432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120827.117802:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922338432:12345-0@lo:400:kworker.0 Request processed in 43us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120827.117809:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789120827.117835:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd9d074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922338432:0@lo:400:kworker.0 00000100:00080000:2.0:1789120827.118114:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789120827.488927:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120827.488941:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120827.488992:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789120827.489000:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789120827.638962:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120827.687751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120827.687890:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357056 00000100:00100000:2.0:1789120827.687900:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357056 00000100:00100000:2.0:1789120827.687988:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 133 00000100:00100000:2.0:1789120827.687998:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:10773:x1876028901357056:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120827.688020:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120827.688039:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af3b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.688199:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa56a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.688215:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa56a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.688243:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa56a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120827.688256:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789120827.688381:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af3b expref: 27 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.688414:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa56a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af3b expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.688424:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120827.688426:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789120827.688430:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4a00, rc 0) 00000100:00100000:2.0:1789120827.688494:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:10773:x1876028901357056:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 498us (753us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789120827.688502:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 133 00000100:00080000:0.0:1789120827.688877:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120827.698840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120827.698970:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357184 00000100:00100000:2.0:1789120827.698984:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357184 00000100:00100000:2.0:1789120827.699065:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00100000:2.0:1789120827.699083:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:10773:x1876028901357184:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789120827.699192:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699208:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699220:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699265:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699272:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699278:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699284:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120827.699288:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699296:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699309:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:2.0:1789120827.699312:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120827.699317:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120827.699324:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa56ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120827.699406:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:10773:x1876028901357184:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 325us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120827.700033:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00100000:1.0:1789120827.823051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120827.823287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120827.823324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120827.823341:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357312 00000100:00100000:2.0:1789120827.823354:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357312 00000100:00100000:3.0:1789120827.823365:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120827.823430:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357568 00000100:00100000:2.0:1789120827.823450:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357568 00000100:00100000:2.0:1789120827.823482:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:2.0:1789120827.823493:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901357568:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120827.823576:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:2.0:1789120827.823583:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901357568:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120827.823590:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901357312:12345-192.168.206.9@tcp:101:cat.0 00000100:00100000:2.0:1789120827.823597:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00010000:00010000:3.0:1789120827.823616:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120827.823641:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa56b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af42 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120827.823672:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3d137, atime: 0x6aa3d137, ctime: 0x6aa3d137, blocks: 0xb 00000100:00100000:1.0:1789120827.823675:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357440 00000100:00100000:1.0:1789120827.823681:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357440 00010000:00010000:3.0:1789120827.823692:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789120827.823697:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120827.823708:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa56b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af42 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120827.823722:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 314 00010000:00010000:3.0:1789120827.823730:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa56b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af42 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120827.823733:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901357440:12345-192.168.206.9@tcp:400:kworker.0 00010000:00010000:3.0:1789120827.823752:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390a400, rc 0) 00000100:00100000:1.0:1789120827.823768:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901357440:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120827.823776:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 314 00000100:00100000:3.0:1789120827.823783:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901357312:12345-192.168.206.9@tcp:101:cat.0 Request processed in 197us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120827.823791:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:0.0:1789120827.823998:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357696 00000100:00100000:0.0:1789120827.824003:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357696 00000100:00100000:0.0:1789120827.824051:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00100000:0.0:1789120827.824059:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d0761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901357696:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120827.824093:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d0761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901357696:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120827.824100:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 134 00000100:00080000:0.0:1789120827.824118:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120827.824123:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120827.824125:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120827.828124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120827.828600:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357824 00000100:00100000:0.0:1789120827.828632:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357824 00002000:00100000:0.0:1789120827.828698:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ffdb58f8780 x1876028901357824/t0(0) o3->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:358/0 lens 488/0 e 0 to 0 dl 1789120838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120827.828711:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb58f8780 with x1876028901357824 ext(0->4095) 00002000:00010000:0.0:1789120827.828718:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb58f8780 00000100:00100000:0.0:1789120827.828760:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789120827.828772:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901357824:12345-192.168.206.9@tcp:3:cat.0 00000100:00100000:0.0:1789120827.829066:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901357824:12345-192.168.206.9@tcp:3:cat.0 Request processed in 295us (953us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789120827.829075:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00002000:00100000:0.0:1789120827.829082:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ffdb58f8780 x1876028901357824/t0(0) o3->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:358/0 lens 488/4536 e 0 to 0 dl 1789120838 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120827.829091:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb58f8780 with x1876028901357824 ext(0->4095) 00002000:00010000:0.0:1789120827.829094:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb58f8780 00010000:00010000:1.0:1789120828.650846:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120829.683661:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789120829.744206:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789120829.744222:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789120829.762700:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1789120829.762890:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789120829.762911:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffd87214b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789120829.762916:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb57f5500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffc81089f00 00000020:00080000:3.0:1789120829.762920:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb57f5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb9657400 00000020:00080000:3.0:1789120829.762944:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789120829.762986:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789120829.763678:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789120830.698694:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120830.698983:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120830.699004:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb58f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922338688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120830.699090:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120830.699355:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338688 00000100:00100000:0.0:1789120830.699362:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338688 00000100:00100000:0.0:1789120830.699421:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789120830.699431:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922338688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120830.699466:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120830.699507:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d075680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922338688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120830.699515:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789120830.699710:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120830.699810:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789120830.699817:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789120830.699841:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb58f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922338688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789120831.725217:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120832.234913:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922338944:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.234980:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235028:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922339456:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235054:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235083:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789120832.235089:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922338816:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235113:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235136:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922339328:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235190:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235214:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922339072:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235233:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235252:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120832.235257:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922339200:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235278:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235308:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338944 00000100:00100000:2.0:1789120832.235324:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338944 00000100:00100000:2.0:1789120832.235366:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339328 00000100:00100000:2.0:1789120832.235369:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339328 00000100:00100000:2.0:1789120832.235391:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339072 00000100:00100000:2.0:1789120832.235394:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339072 00000100:00100000:2.0:1789120832.235408:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789120832.235416:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9506940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922338944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235465:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9506940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922338944:12345-0@lo:400:kworker.0 Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235472:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789120832.235490:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789120832.235495:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922339328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235521:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922339328:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235526:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789120832.235537:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789120832.235543:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922339072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235574:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922339072:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235580:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789120832.235598:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339456 00000100:00100000:2.0:1789120832.235602:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339456 00000100:00100000:2.0:1789120832.235624:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339200 00000100:00100000:2.0:1789120832.235627:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339200 00000100:00100000:2.0:1789120832.235647:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789120832.235654:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922339456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235683:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922339456:12345-0@lo:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235699:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789120832.235711:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789120832.235717:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922339200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235745:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922339200:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235750:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789120832.235767:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922338816 00000100:00100000:2.0:1789120832.235769:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922338816 00000100:00100000:2.0:1789120832.235791:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789120832.235796:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922338816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.235822:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922338816:12345-0@lo:400:kworker.0 Request processed in 26us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.235827:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:2.0:1789120832.235900:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120832.235903:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120832.235905:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120832.235918:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120832.235926:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb998f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922339584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120832.235951:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.235975:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339584 00000100:00100000:2.0:1789120832.235979:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339584 00000100:00100000:2.0:1789120832.236003:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789120832.236009:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922339584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120832.236037:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120832.236070:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922339584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.236084:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789120832.236123:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb998f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922339584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120832.236166:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922339200:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.236175:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922339072:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.236195:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922338816:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.236204:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922339328:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.236212:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922338944:0@lo:400:kworker.0 00000100:00100000:2.0:1789120832.236219:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922339456:0@lo:400:kworker.0 00000100:00100000:0.0:1789120832.363836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120832.364243:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901357952 00000100:00100000:2.0:1789120832.364256:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901357952 00000100:00100000:2.0:1789120832.364359:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 135 00000100:00100000:2.0:1789120832.364372:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10425:x1876028901357952:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1789120832.364690:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120832.364725:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10425:x1876028901357952:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 Request processed in 353us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.364736:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 135 00000100:00100000:3.0:1789120832.374376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120832.378664:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358208 00000100:00100000:0.0:1789120832.378684:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358208 00000100:00100000:0.0:1789120832.379272:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789120832.379288:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:10425:x1876028901358208:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789120832.380072:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:10425:x1876028901358208:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 786us (5709us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789120832.380085:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789120832.629340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120832.629481:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358336 00000100:00100000:2.0:1789120832.629495:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358336 00000100:00100000:2.0:1789120832.629610:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00100000:2.0:1789120832.629622:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:11225:x1876028901358336:12345-192.168.206.9@tcp:101:lsof.0 00010000:00010000:2.0:1789120832.629649:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120832.629676:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa56bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af49 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.629788:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.629819:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.629836:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120832.630080:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789120832.630085:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120832.630231:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.630261:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa56bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 7 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.630281:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 6 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120832.630291:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120832.630294:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120832.630298:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120832.630382:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+6:11225:x1876028901358336:12345-192.168.206.9@tcp:101:lsof.0 Request processed in 762us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.630391:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 136 00000100:00080000:1.0:1789120832.631506:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120832.750329:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120832.945965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120832.946006:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120832.946038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120832.946075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120832.946179:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358848 00000100:00100000:2.0:1789120832.946196:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358848 00000100:00100000:2.0:1789120832.946299:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358720 00000100:00100000:2.0:1789120832.946303:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358720 00000100:00100000:2.0:1789120832.946332:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:2.0:1789120832.946343:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901358848:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120832.946387:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:1.0:1789120832.946404:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901358720:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120832.946515:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901358848:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 159us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120832.946516:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2352:x1876028901358720:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.946517:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358464 00000100:00100000:0.0:1789120832.946525:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358464 00000100:00100000:2.0:1789120832.946545:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789120832.946559:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:0.0:1789120832.946570:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 316 00000100:00100000:0.0:1789120832.946592:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901358464:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:1.0:1789120832.946617:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120832.946625:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120832.946636:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901358464:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 47us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.946645:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 316 00000100:00100000:3.0:1789120832.946678:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901358592 00000100:00100000:3.0:1789120832.946684:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901358592 00000100:00100000:3.0:1789120832.946747:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 138 00000100:00100000:3.0:1789120832.946761:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2352:x1876028901358592:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120832.946811:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2352:x1876028901358592:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 56us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120832.946819:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 138 00010000:00010000:2.0:1789120833.773580:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120834.797989:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789120834.885097:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789120834.885116:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789120834.885411:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789120834.885423:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:2.0:1789120834.990255:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120834.990268:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120834.991363:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789120834.991622:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1789120835.755313:0:12709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:00:34 (1789120834) 00000100:00100000:2.0:1789120835.818719:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120835.818739:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb998c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922339712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120835.818812:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120835.818881:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339712 00000100:00100000:2.0:1789120835.818888:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339712 00000100:00100000:2.0:1789120835.818938:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789120835.818947:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922339712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120835.818979:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120835.819032:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922339712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120835.819039:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789120835.819060:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120835.819094:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb998c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922339712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789120835.819421:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120836.843788:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120837.006510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120837.007300:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359104 00000100:00100000:2.0:1789120837.007336:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359104 00000100:00100000:2.0:1789120837.007417:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 137 00000100:00100000:2.0:1789120837.007428:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:11490:x1876028901359104:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120837.007449:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120837.007469:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af50 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007544:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007558:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007569:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007598:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007606:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.007613:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789120837.008053:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120837.008277:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008289:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008297:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120837.008438:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789120837.008628:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008637:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008644:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008650:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120837.008654:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008662:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008674:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7ca00) 00010000:00010000:2.0:1789120837.008677:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120837.008681:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008687:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa56d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008698:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008704:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008720:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008726:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120837.008729:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008735:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008742:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffd84cf3200) 00010000:00010000:2.0:1789120837.008744:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120837.008747:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.008753:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.009840:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af50 expref: 16 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.009997:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af50 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120837.010008:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:2.0:1789120837.010010:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120837.010013:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4800, rc 0) 00000100:00100000:2.0:1789120837.010167:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:11490:x1876028901359104:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 2717us (3642us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789120837.010187:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 137 00000100:00100000:1.0:1789120837.021056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120837.022286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359232 00000100:00100000:0.0:1789120837.022297:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359232 00000100:00100000:0.0:1789120837.022370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789120837.022380:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0247450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:2352:x1876028901359232:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120837.022396:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120837.022420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af50 expref: 15 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120837.022460:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:0.0:1789120837.022466:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120837.022524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0247450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2352:x1876028901359232:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 146us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.022533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789120837.029674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120837.029876:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359360 00000100:00100000:2.0:1789120837.029885:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359360 00000100:00100000:2.0:1789120837.029943:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 138 00000100:00100000:2.0:1789120837.029953:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11490:x1876028901359360:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789120837.030058:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11490:x1876028901359360:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120837.030066:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 138 00000040:00080000:2.0:1789120837.034421:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120837.034429:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120837.034462:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789120837.034468:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120837.355460:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120837.355499:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb998c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922339840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120837.355586:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120837.355670:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339840 00000100:00100000:2.0:1789120837.355677:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339840 00000100:00100000:2.0:1789120837.355737:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789120837.355747:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922339840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120837.355789:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120837.355849:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922339840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120837.355857:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789120837.355882:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120837.355923:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb998c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922339840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120837.357420:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922340096:0@lo:400:kworker.0 00000100:00100000:0.0:1789120837.357697:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120837.357750:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120837.357757:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922340224:0@lo:400:kworker.0 00000100:00100000:0.0:1789120837.357784:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120837.357837:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922340096 00000100:00100000:0.0:1789120837.357846:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922340096 00000100:00100000:0.0:1789120837.357901:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922340224 00000100:00100000:0.0:1789120837.357904:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922340224 00000100:00100000:0.0:1789120837.357941:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120837.357951:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922340096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120837.358008:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922340096:12345-0@lo:400:kworker.0 Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.358017:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120837.358036:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789120837.358042:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922340224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120837.358071:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922340224:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.358078:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789120837.358104:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120837.358189:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922340224:0@lo:400:kworker.0 00000100:00100000:0.0:1789120837.358202:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922340096:0@lo:400:kworker.0 00000100:00100000:1.0:1789120837.358310:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922340352:0@lo:400:kworker.0 00000100:00100000:1.0:1789120837.358351:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120837.358388:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789120837.358395:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922339968:0@lo:400:kworker.0 00000100:00100000:1.0:1789120837.358426:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120837.358460:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922340480:0@lo:400:kworker.0 00000100:00100000:1.0:1789120837.358497:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120837.361561:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922340480 00000100:00100000:0.0:1789120837.361741:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922340352 00000100:00100000:0.0:1789120837.361749:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922340352 00000100:00100000:0.0:1789120837.361854:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789120837.361867:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120837.362464:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922340480 00000100:00080000:1.0:1789120837.362919:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120837.362925:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120837.362999:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789120837.363013:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922340480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120837.364803:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922340480:12345-0@lo:400:kworker.0 Request processed in 1781us (6292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.364803:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922340352:12345-0@lo:400:kworker.0 Request processed in 2926us (6438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.364840:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789120837.364841:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789120837.364902:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922339968 00000100:00100000:2.0:1789120837.364913:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922339968 00000100:00100000:2.0:1789120837.364967:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789120837.364978:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922339968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120837.365031:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922339968:12345-0@lo:400:kworker.0 Request processed in 54us (6603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120837.365038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789120837.365112:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922339968:0@lo:400:kworker.0 00000100:00100000:2.0:1789120837.365131:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922340480:0@lo:400:kworker.0 00000100:00100000:2.0:1789120837.365170:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922340352:0@lo:400:kworker.0 00010000:00010000:1.0:1789120837.872090:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120838.070323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120838.070425:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359488 00000100:00100000:2.0:1789120838.070438:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359488 00000100:00100000:1.0:1789120838.070448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120838.070496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120838.070497:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 318 00000100:00100000:2.0:1789120838.070508:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901359488:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120838.070515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120838.070543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120838.070568:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360000 00000100:00100000:1.0:1789120838.070571:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360000 00000100:00100000:2.0:1789120838.070597:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901359488:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120838.070605:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 318 00000100:00100000:1.0:1789120838.070613:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359616 00000100:00100000:1.0:1789120838.070615:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359616 00000100:00100000:1.0:1789120838.070633:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:1.0:1789120838.070639:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+6:2350:x1876028901360000:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120838.070656:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359744 00000100:00100000:2.0:1789120838.070659:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359744 00000100:00100000:1.0:1789120838.070678:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62440a6e-232c-434d-8868-70f19c1fd072+6:2350:x1876028901360000:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120838.070686:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:2.0:1789120838.070687:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901359872 00000100:00100000:2.0:1789120838.070690:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901359872 00000100:00100000:1.0:1789120838.070701:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 143 00000100:00100000:1.0:1789120838.070706:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2350:x1876028901359616:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120838.070708:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789120838.070713:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901359744:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120838.070730:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2350:x1876028901359616:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120838.070736:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 143 00000100:00100000:2.0:1789120838.070737:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901359744:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120838.070742:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:2.0:1789120838.070752:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00080000:1.0:1789120838.070753:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120838.070757:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901359872:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:1.0:1789120838.070757:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120838.070760:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120838.070779:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901359872:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 22us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120838.070786:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00010000:00010000:3.0:1789120838.901904:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120838.902113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120838.902260:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360128 00000100:00100000:2.0:1789120838.902269:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360128 00000100:00100000:2.0:1789120838.902329:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 139 00000100:00100000:2.0:1789120838.902339:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11532:x1876028901360128:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120838.902359:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120838.902379:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af57 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902442:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902455:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902485:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902500:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902507:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902513:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902746:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902754:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902760:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902765:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120838.902769:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902777:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902789:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120838.902792:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120838.902975:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.902990:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa56f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903003:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903009:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903015:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903020:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120838.903023:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903029:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903037:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffd84cf3200) 00010000:00010000:2.0:1789120838.903040:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120838.903043:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903049:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa56fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903080:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af57 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903101:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120838.903104:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120838.903108:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa56ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af57 expref: 15 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.903116:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4000, rc 0) 00000100:00100000:2.0:1789120838.903340:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11532:x1876028901360128:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1001us (1231us total) trans 0 rc 301/301 00000100:00100000:2.0:1789120838.903348:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 139 00000100:00100000:2.0:1789120838.908657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120838.908737:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360384 00000100:00100000:3.0:1789120838.908746:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360384 00000100:00100000:3.0:1789120838.908814:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 140 00000100:00100000:3.0:1789120838.908825:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11532:x1876028901360384:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:3.0:1789120838.908887:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120838.908916:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa506b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad90 expref: 14 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.908932:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:3.0:1789120838.908937:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120838.909325:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.909339:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 5 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.909359:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.909395:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 5 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.909410:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 5 pid: 5858 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120838.909424:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafcc7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922340608:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120838.909514:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120838.914554:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120838.914590:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360512 00000100:00100000:3.0:1789120838.914598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360512 00010000:00010000:3.0:1789120838.914633:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 6 pid: 5858 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120838.914666:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:3.0:1789120838.914675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62440a6e-232c-434d-8868-70f19c1fd072+6:2349:x1876028901360512:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120838.914688:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120838.914694:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 6 pid: 5858 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.914707:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 6 pid: 5858 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.914750:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:3.0:1789120838.914755:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.914764:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.914771:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120838.914839:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120838.914886:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62440a6e-232c-434d-8868-70f19c1fd072+6:2349:x1876028901360512:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 212us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120838.914895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00010000:00010000:2.0:1789120838.915443:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa56c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af49 expref: 5 pid: 5858 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120838.915461:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafcc7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922340608:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120838.915480:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.915489:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.915494:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.915515:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.915525:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.915542:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120838.916740:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789120838.916755:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916763:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916770:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916775:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120838.916779:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916786:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916798:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82a3fb00) 00010000:00010000:2.0:1789120838.916801:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120838.916821:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120838.916828:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa5702 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120838.916851:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cbd42782 reply state 000000000cc38ac2 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120838.916870:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120838.916959:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:11532:x1876028901360384:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 8133us (8309us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789120838.916967:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 140 00010000:00010000:1.0:1789120838.918668:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918692:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918700:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918706:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120838.918710:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918718:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918733:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120838.918748:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120838.918753:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120838.918759:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5709 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120839.004414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120839.004455:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360640 00000100:00100000:3.0:1789120839.004463:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360640 00000100:00100000:3.0:1789120839.004519:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00100000:3.0:1789120839.004529:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:11540:x1876028901360640:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:3.0:1789120839.004550:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120839.004573:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af5e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004636:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004650:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004673:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120839.004733:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789120839.004738:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120839.004768:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004793:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af5e expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004824:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af5e expref: 15 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.004833:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:3.0:1789120839.004836:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120839.004839:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390aa00, rc 0) 00000100:00100000:3.0:1789120839.004894:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:11540:x1876028901360640:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 367us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.004901:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 141 00000100:00080000:3.0:1789120839.004922:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120839.062272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.062431:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901360768 00000100:00100000:2.0:1789120839.062441:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901360768 00000100:00100000:2.0:1789120839.062501:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:2.0:1789120839.062512:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+15:11546:x1876028901360768:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120839.062531:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120839.062549:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa571e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af65 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062607:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062620:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062632:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062645:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062653:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062660:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062790:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062799:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062818:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120839.062849:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1789120839.062853:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120839.062875:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062887:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062894:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062900:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062906:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120839.062910:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062918:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062929:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:2.0:1789120839.062938:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120839.062944:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062951:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062964:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062970:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062976:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062982:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120839.062984:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062990:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.062998:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ffd84cf3200) 00010000:00010000:2.0:1789120839.063000:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120839.063003:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.063009:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa572c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.063037:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa571e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af65 expref: 17 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.063060:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af65 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.063067:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120839.063069:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789120839.063072:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4400, rc 0) 00000100:00100000:2.0:1789120839.063214:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:11546:x1876028901360768:12345-192.168.206.9@tcp:101:bash.0 Request processed in 703us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.063222:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 142 00000100:00100000:3.0:1789120839.073015:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.073102:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361024 00000100:00100000:1.0:1789120839.073111:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361024 00000100:00100000:0.0:1789120839.073349:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 143 00000100:00100000:0.0:1789120839.073360:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+16:11546:x1876028901361024:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120839.073380:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120839.073399:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa573a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af6c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073537:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073552:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073564:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073618:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073626:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.073646:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789120839.074241:0:5859:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789120839.074409:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074419:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074428:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074465:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074472:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074478:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074485:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120839.074489:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074497:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074510:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120839.074513:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120839.074525:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074532:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5741 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120839.074545:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ef331095 reply state 00000000d0f6c8a3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120839.074553:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789120839.074584:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa573a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 19 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074597:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.074605:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.074607:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120839.074610:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b400, rc 0) 00000100:00100000:0.0:1789120839.074678:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11546:x1876028901361024:12345-192.168.206.9@tcp:101:bash.0 Request processed in 1321us (1672us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789120839.074687:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 143 00010000:00010000:1.0:1789120839.079350:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079380:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079388:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079394:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120839.079399:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079407:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079425:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd9fd7c700) 00010000:00010000:1.0:1789120839.079428:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120839.079434:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.079441:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5748 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120839.079749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.079832:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361152 00000100:00100000:2.0:1789120839.079841:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361152 00000100:00100000:2.0:1789120839.079900:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789120839.079911:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901361152:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120839.079927:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120839.079943:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af73 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120839.079966:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120839.079985:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1789120839.079989:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120839.079997:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.080015:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.080040:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120839.080099:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901361152:12345-192.168.206.9@tcp:101:bash.0 Request processed in 190us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.080106:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:1.0:1789120839.089638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.089791:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361280 00000100:00100000:2.0:1789120839.089799:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361280 00000100:00100000:2.0:1789120839.089858:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:2.0:1789120839.089866:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:11546:x1876028901361280:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120839.089882:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120839.089898:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af7a expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.089936:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.089945:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120839.089950:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120839.089955:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.089985:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.089998:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.090030:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1876028922340736:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120839.090118:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95781180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120839.092770:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.092869:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb9505680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1876028922340736:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120839.092902:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.092930:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4800, rc 0) 00000100:00100000:2.0:1789120839.092989:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:11546:x1876028901361280:12345-192.168.206.9@tcp:101:bash.0 Request processed in 3123us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.092997:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789120839.093596:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361408 00000100:00100000:1.0:1789120839.093604:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361408 00010000:00010000:1.0:1789120839.093637:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.093661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:1.0:1789120839.093670:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901361408:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120839.093683:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120839.093702:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.093715:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.093737:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa575d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af73 expref: 7 pid: 6705 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.093749:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120839.093753:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120839.093760:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.093769:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.093833:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.093847:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1876028922340864:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789120839.093920:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120839.096859:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5843:1876028922340864:192.168.206.9@tcp:105: 00010000:00010000:1.0:1789120839.096890:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120839.096953:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901361408:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 3283us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.096964:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:2.0:1789120839.106451:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.106592:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361664 00000100:00100000:0.0:1789120839.106601:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361664 00000100:00100000:0.0:1789120839.106650:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:0.0:1789120839.106659:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11546:x1876028901361664:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789120839.106971:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11546:x1876028901361664:12345-192.168.206.9@tcp:35:bash.0 Request processed in 312us (531us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789120839.106979:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:3.0:1789120839.248519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.248665:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901361920 00000100:00100000:2.0:1789120839.248674:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901361920 00000100:00100000:2.0:1789120839.248749:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 144 00000100:00100000:2.0:1789120839.248759:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11556:x1876028901361920:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120839.248782:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120839.248815:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa576b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af81 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120839.248936:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789120839.249048:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa576b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af81 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.249062:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:2.0:1789120839.249078:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120839.249084:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa576b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af81 expref: 21 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.249098:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5c00, rc 0) 00000100:00100000:2.0:1789120839.249205:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11556:x1876028901361920:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 447us (694us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789120839.249212:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 144 00000100:00100000:3.0:1789120839.255050:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.255183:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901362176 00000100:00100000:0.0:1789120839.255191:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901362176 00000100:00100000:0.0:1789120839.255246:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:0.0:1789120839.255256:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11556:x1876028901362176:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120839.255710:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:11556:x1876028901362176:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 454us (678us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789120839.255719:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789120839.358660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120839.358749:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901362304 00000100:00100000:3.0:1789120839.358772:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901362304 00000100:00100000:3.0:1789120839.358842:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 145 00000100:00100000:3.0:1789120839.358853:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:11562:x1876028901362304:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120839.358875:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120839.358907:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af88 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.358967:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.358980:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.358991:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120839.359046:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789120839.359050:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120839.359071:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.359097:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a800/0x13cfa3d77faa5779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af88 expref: 23 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.359113:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af88 expref: 22 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.359121:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:3.0:1789120839.359124:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120839.359127:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8390ae00, rc 0) 00000100:00100000:3.0:1789120839.359501:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11562:x1876028901362304:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 649us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.359509:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 145 00000100:00100000:3.0:1789120839.364572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.364633:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901362560 00000100:00100000:0.0:1789120839.364642:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901362560 00000100:00100000:0.0:1789120839.364702:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00100000:0.0:1789120839.364713:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11562:x1876028901362560:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120839.364731:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120839.364750:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af8f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.364852:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa578e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.364866:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa578e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.364877:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa578e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120839.364888:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789120839.365016:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af8f expref: 25 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.365032:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa578e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af8f expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.365051:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.365054:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120839.365058:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120839.365117:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11562:x1876028901362560:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 406us (553us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789120839.365124:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 146 00000100:00100000:1.0:1789120839.370630:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.370672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.370765:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901362944 00000100:00100000:0.0:1789120839.370774:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901362944 00000100:00100000:0.0:1789120839.370844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789120839.370854:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:2349:x1876028901362944:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120839.370868:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120839.370890:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa578e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af8f expref: 24 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.370909:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.370914:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120839.370971:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:2349:x1876028901362944:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.370979:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789120839.371033:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901362816 00000100:00100000:3.0:1789120839.371037:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901362816 00000100:00100000:3.0:1789120839.371069:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00100000:3.0:1789120839.371076:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:11562:x1876028901362816:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120839.371092:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120839.371105:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa579c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af96 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.371210:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.371224:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.371234:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120839.371245:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789120839.371466:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390a600/0x13cfa3d77faa579c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af96 expref: 26 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.371482:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af96 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120839.371490:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:3.0:1789120839.371504:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789120839.371508:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691c00, rc 0) 00000100:00100000:3.0:1789120839.371532:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11562:x1876028901362816:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 456us (911us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789120839.371538:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00100000:3.0:1789120839.385901:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.386002:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363072 00000100:00100000:1.0:1789120839.386012:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363072 00000100:00100000:1.0:1789120839.386067:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:1.0:1789120839.386076:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901363072:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:1.0:1789120839.386117:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.386136:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.386182:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120839.386201:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120839.386206:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.386241:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.386255:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 6 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.386281:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1876028922340992:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120839.386390:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120839.390068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.390201:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1876028922340992:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120839.390226:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.390587:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363200 00000100:00100000:2.0:1789120839.390594:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363200 00002000:00100000:2.0:1789120839.390638:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ffdafe9c000 x1876028901363200/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:370/0 lens 504/0 e 0 to 0 dl 1789120850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789120839.390647:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdafe9c000 with x1876028901363200 ext(0->12) 00010000:00010000:2.0:1789120839.390654:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 7 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.390667:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 7 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120839.390675:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdafe9c000 00000100:00100000:2.0:1789120839.390696:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789120839.390704:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901363200:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:2.0:1789120839.391263:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901363200:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 557us (1201us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789120839.391272:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00002000:00100000:2.0:1789120839.391289:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ffdafe9c000 x1876028901363200/t4294967305(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:370/0 lens 504/448 e 0 to 0 dl 1789120850 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789120839.391305:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdafe9c000 with x1876028901363200 ext(0->12) 00010000:00010000:2.0:1789120839.391312:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.391324:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120839.391331:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdafe9c000 00000100:00100000:3.0:1789120839.400112:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.400274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363328 00000100:00100000:1.0:1789120839.400283:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363328 00010000:00010000:1.0:1789120839.400322:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.400362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:1.0:1789120839.400371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901363328:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120839.400386:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789120839.400403:0:5843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789120839.400406:0:5843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789120838 00002000:00010000:1.0:1789120839.400408:0:5843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789120839 00002000:00010000:1.0:1789120839.400410:0:5843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789120838 00010000:00010000:1.0:1789120839.400416:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.400448:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.400470:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa5764 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af7a expref: 9 pid: 6707 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.400497:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120839.400503:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120839.400508:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.400519:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.400556:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120839.400610:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901363328:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 239us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.400619:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00010000:00010000:2.0:1789120839.401194:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401206:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401234:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401243:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401252:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401259:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120839.401263:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401282:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401294:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.401301:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd27234c/0x13cfa3d77faa57b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.401692:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901363072:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 15605us (15789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.401701:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:3.0:1789120839.404108:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.404200:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363584 00000100:00100000:0.0:1789120839.404221:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363584 00000100:00100000:0.0:1789120839.404267:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:0.0:1789120839.404276:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11562:x1876028901363584:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:0.0:1789120839.404334:0:5861:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af96 expref: 25 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120839.404724:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789120839.404767:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789120839.406091:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789120839.406182:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.406199:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.406207:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.406379:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.406395:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 29 pid: 5859 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120839.406409:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1876028922341120:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120839.406681:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120839.409855:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5861:1876028922341120:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120839.409882:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120839.410652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.410994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363712 00000100:00100000:2.0:1789120839.411002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363712 00010000:00010000:2.0:1789120839.411037:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 30 pid: 5859 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.411074:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:2.0:1789120839.411082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:2350:x1876028901363712:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120839.411096:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120839.411102:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 30 pid: 5859 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411114:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 30 pid: 5859 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411178:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa574f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af6c expref: 30 pid: 5859 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411194:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:2.0:1789120839.411199:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411208:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411215:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.411233:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120839.411336:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.411344:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120839.411476:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789120839.411642:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789120839.411740:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1876028922341248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789120839.411781:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.411821:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb55030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120839.411839:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922341248 00000100:00100000:0.0:1789120839.411843:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922341248 00000100:00100000:0.0:1789120839.411878:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120839.411885:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1876028922341248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789120839.411944:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1876028922341248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.411951:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789120839.411968:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120839.411989:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1876028922341248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789120839.412378:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789120839.412422:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1876028922341376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789120839.412449:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.412471:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922341376 00000100:00100000:0.0:1789120839.412474:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922341376 00000100:00100000:0.0:1789120839.412492:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120839.412498:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1876028922341376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789120839.412616:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1876028922341376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (165us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789120839.412623:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120839.412639:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120839.412654:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb99cda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5861:1876028922341376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789120839.412687:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1789120839.412714:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412724:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412731:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412737:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120839.412741:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412748:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412761:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.412763:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789120839.412767:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.412773:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789120839.412927:0:5861:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789120839.413032:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1789120839.413043:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306666898456ns, next at 307666895726ns, rc = 0 00000001:00080000:0.0:1789120839.413049:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1789120839.413078:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.413081:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789120839.413088:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa57a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af96 expref: 34 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.413426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:2350:x1876028901363712:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 2342us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.413435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:0.0:1789120839.413754:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11562:x1876028901363584:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 9477us (9651us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789120839.413762:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00000020:00080000:0.0:1789120839.413767:0:5861:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789120839.419999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.420136:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901363840 00000100:00100000:0.0:1789120839.420638:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901363840 00000100:00100000:0.0:1789120839.420767:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 148 00000100:00100000:0.0:1789120839.420778:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11562:x1876028901363840:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120839.420810:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120839.420834:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa57bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8af9d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.420893:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa57bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af9d expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.420907:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa57bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af9d expref: 33 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.420925:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120839.420928:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120839.420943:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4be00, rc 0) 00000100:00100000:0.0:1789120839.421005:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11562:x1876028901363840:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 229us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.421012:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 148 00000100:00100000:3.0:1789120839.425410:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.426252:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901364096 00000100:00100000:2.0:1789120839.426267:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901364096 00000100:00100000:2.0:1789120839.426391:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:2.0:1789120839.426402:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11562:x1876028901364096:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120839.426908:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11562:x1876028901364096:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 506us (1505us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789120839.426917:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:3.0:1789120839.496127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.496273:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901364352 00000100:00100000:0.0:1789120839.496282:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901364352 00000100:00100000:0.0:1789120839.496348:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 149 00000100:00100000:0.0:1789120839.496366:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11572:x1876028901364352:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120839.496388:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120839.496409:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afa4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120839.496516:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789120839.496629:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afa4 expref: 36 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.496643:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:0.0:1789120839.496646:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789120839.496651:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afa4 expref: 36 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.496664:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120839.496716:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11572:x1876028901364352:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 360us (598us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789120839.496724:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 149 00000100:00100000:3.0:1789120839.504870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.504981:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901364480 00000100:00100000:1.0:1789120839.504991:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901364480 00000100:00100000:1.0:1789120839.505051:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:1.0:1789120839.505061:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11572:x1876028901364480:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:1.0:1789120839.505139:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505197:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505223:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505239:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505246:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505253:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505344:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505365:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505373:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120839.505414:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505426:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505432:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505439:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505456:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120839.505461:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505469:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505480:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120839.505483:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120839.505488:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505494:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa57d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505506:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505511:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505516:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505521:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120839.505524:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505529:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505549:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f700) 00010000:00010000:1.0:1789120839.505551:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120839.505554:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505560:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa57db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505573:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505579:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505585:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505590:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120839.505593:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505599:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505605:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120839.505607:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120839.505610:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.505616:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa57e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.505697:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11572:x1876028901364480:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 637us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.505706:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 150 00000100:00100000:1.0:1789120839.516178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.516270:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901364736 00000100:00100000:0.0:1789120839.516279:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901364736 00000100:00100000:0.0:1789120839.516332:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:0.0:1789120839.516364:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11572:x1876028901364736:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120839.516620:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11572:x1876028901364736:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 258us (449us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789120839.516628:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789120839.587290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.587398:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901364992 00000100:00100000:0.0:1789120839.587406:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901364992 00000100:00100000:0.0:1789120839.587469:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:0.0:1789120839.587479:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11575:x1876028901364992:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120839.587499:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120839.587518:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afab expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587582:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587595:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587605:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587620:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587628:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587635:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587774:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587784:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587791:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120839.587812:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789120839.587902:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587909:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587915:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587932:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120839.587937:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587943:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587954:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120839.587957:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120839.587961:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587977:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa57f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587990:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.587996:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588001:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588005:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120839.588007:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588012:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588019:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120839.588022:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120839.588024:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588029:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa57f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588066:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa57e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 39 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588079:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 38 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.588092:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120839.588094:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120839.589642:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b200, rc 0) 00000100:00100000:0.0:1789120839.589712:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11575:x1876028901364992:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 2231us (2428us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789120839.589722:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:0.0:1789120839.595210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.595416:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901365120 00000100:00100000:1.0:1789120839.595425:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901365120 00000100:00100000:1.0:1789120839.595571:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:1.0:1789120839.595582:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb58fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11575:x1876028901365120:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789120839.595644:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595661:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595672:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595698:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595706:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595713:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595719:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120839.595723:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595747:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595759:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120839.595762:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120839.595767:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.595774:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa580c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.595893:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb58fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11575:x1876028901365120:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 313us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.595902:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:1.0:1789120839.599035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.599125:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901365376 00000100:00100000:0.0:1789120839.599134:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901365376 00000100:00100000:0.0:1789120839.599391:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:0.0:1789120839.599402:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11575:x1876028901365376:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120839.599659:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11575:x1876028901365376:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 258us (630us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789120839.599668:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789120839.900070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.900135:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901365632 00000100:00100000:2.0:1789120839.900170:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901365632 00000100:00100000:2.0:1789120839.900233:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 153 00000100:00100000:2.0:1789120839.900256:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11606:x1876028901365632:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:2.0:1789120839.900286:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120839.900306:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afb2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.900404:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa581a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.900417:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa581a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.900429:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa581a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120839.900440:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789120839.900572:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb2 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.900589:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa581a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb2 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.900597:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:2.0:1789120839.900599:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120839.900603:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4800, rc 0) 00000100:00100000:2.0:1789120839.900661:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11606:x1876028901365632:12345-192.168.206.9@tcp:101:cat.0 Request processed in 407us (597us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789120839.900668:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 153 00000100:00100000:3.0:1789120839.909827:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.909937:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901365888 00000100:00100000:1.0:1789120839.909951:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901365888 00000100:00100000:1.0:1789120839.910082:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789120839.910092:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11606:x1876028901365888:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:1.0:1789120839.910447:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:11606:x1876028901365888:12345-192.168.206.9@tcp:35:cat.0 Request processed in 356us (645us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789120839.910456:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789120839.913453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120839.913613:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901366016 00000100:00100000:0.0:1789120839.913626:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901366016 00000100:00100000:0.0:1789120839.913713:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789120839.913734:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:2349:x1876028901366016:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120839.913755:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120839.913784:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa581a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb2 expref: 42 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120839.913814:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120839.913821:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120839.913911:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:2349:x1876028901366016:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 189us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.913920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00010000:00010000:2.0:1789120839.920679:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120839.991754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120839.991859:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901366272 00000100:00100000:1.0:1789120839.991872:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901366272 00000100:00100000:1.0:1789120839.991982:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 154 00000100:00100000:1.0:1789120839.991995:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11612:x1876028901366272:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:1.0:1789120839.992047:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120839.992061:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789120839.992101:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390ae00/0x13cfa3d77faa5780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af88 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992127:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120839.992134:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120839.992194:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5828 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afb9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992325:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992340:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992363:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992404:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.992420:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 41 pid: 5859 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.992437:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d66940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922341504:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120839.992561:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120839.995908:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d66940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922341504:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120839.995953:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120839.996967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120839.997245:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901366400 00000100:00100000:2.0:1789120839.997263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901366400 00010000:00010000:2.0:1789120839.997313:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 42 pid: 5859 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120839.997370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:2.0:1789120839.997382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0245450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:2350:x1876028901366400:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120839.997402:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120839.997410:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 42 pid: 5859 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997425:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 42 pid: 5859 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997455:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa57fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afab expref: 42 pid: 5859 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997476:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:2.0:1789120839.997481:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997493:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997502:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120839.997535:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120839.997603:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0245450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:2350:x1876028901366400:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 222us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120839.997623:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00010000:00010000:1.0:1789120839.998200:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.998211:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120839.998236:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789120839.998600:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5828 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.998622:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 41 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120839.998631:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120839.998635:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120839.998638:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120839.998695:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11612:x1876028901366272:12345-192.168.206.9@tcp:101:dd.0 Request processed in 6703us (6954us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789120839.998704:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 154 00000001:00080000:2.0:1789120840.004019:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:2.0:1789120840.004053:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789120840.004081:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffdb55030c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789120840.004087:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb5985300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb55033c0 00000020:00080000:2.0:1789120840.004090:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffdb5985100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb57fd800 00000001:00080000:2.0:1789120840.004131:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000020:00080000:2.0:1789120840.004189:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789120840.004432:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789120840.004716:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922341632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789120840.004829:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120840.005011:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922341632 00000100:00100000:3.0:1789120840.005020:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922341632 00000100:00100000:3.0:1789120840.005098:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789120840.005257:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922341632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789120840.005300:0:8216:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1789120840.005344:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3d146, atime: 0x6aa3d147, ctime: 0x6aa3d146, blocks: 0x1 00010000:00010000:3.0:1789120840.005354:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.005373:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1789120840.005379:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120840.005404:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.005437:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.005449:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.005457:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.005479:0:8216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789120840.005689:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:1.0:1789120840.005725:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120840.005734:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.005746:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120840.005751:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.005764:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.005812:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.005822:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007582e977/0x13cfa3d77faa583d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.005849:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120840.005852:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120840.005854:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120840.006581:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3319:x1876028922341632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1469us (1749us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789120840.006593:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1789120840.007825:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdc1e6ed00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789120840.007836:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901366656 00000100:00100000:1.0:1789120840.007842:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922341632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789120840.007848:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901366656 00000100:00100000:2.0:1789120840.007930:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 155 00000100:00100000:2.0:1789120840.007941:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:11612:x1876028901366656:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:2.0:1789120840.008303:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120840.008324:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120840.008337:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120840.008392:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789120840.008419:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008bf7d2e9 reply state 00000000538c1f2a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120840.008429:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120840.008819:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11612:x1876028901366656:12345-192.168.206.9@tcp:36:dd.0 Request processed in 876us (3130us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789120840.008847:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 155 00000020:00080000:2.0:1789120840.008853:0:5857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120840.011116:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011136:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011236:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011243:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120840.011250:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011259:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011280:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120840.011301:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120840.011308:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.011314:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5844 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120840.424886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120840.425045:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901366784 00000100:00100000:3.0:1789120840.425058:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901366784 00000100:00100000:3.0:1789120840.425133:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 156 00000100:00100000:3.0:1789120840.425188:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11626:x1876028901366784:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:3.0:1789120840.425220:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120840.425248:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa584b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afc0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425333:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425351:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425384:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425404:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425411:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.425429:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.426099:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.426116:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.426126:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.426642:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.426661:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 20 pid: 5858 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.426679:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922341760:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120840.426875:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeeecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120840.431598:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922341760:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120840.431646:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120840.432701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120840.432833:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901367040 00000100:00100000:0.0:1789120840.432843:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901367040 00000100:00100000:0.0:1789120840.432957:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:0.0:1789120840.432970:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:5588:x1876028901367040:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789120840.434384:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:5588:x1876028901367040:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 1407us (1678us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789120840.434397:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:2.0:1789120840.447743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120840.454844:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901367168 00000100:00100000:3.0:1789120840.454863:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901367168 00010000:00010000:3.0:1789120840.454923:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 22 pid: 5858 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.454967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:3.0:1789120840.454979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:2349:x1876028901367168:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120840.454997:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120840.455005:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 22 pid: 5858 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455020:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 22 pid: 5858 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455047:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa582f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afb9 expref: 22 pid: 5858 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455065:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120840.455071:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455082:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455090:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.455121:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120840.455223:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:2349:x1876028901367168:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 247us (7494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120840.455248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00010000:00010000:3.0:1789120840.456108:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456121:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120840.456214:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789120840.456219:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120840.456243:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456258:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456270:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456277:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456285:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456292:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120840.456297:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456305:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.456319:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:3.0:1789120840.457633:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120840.457644:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457653:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457674:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457680:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457687:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457693:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120840.457697:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457704:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457717:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd831cff00) 00010000:00010000:3.0:1789120840.457720:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120840.457723:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457729:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457788:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa584b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc0 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457835:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc0 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.457843:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120840.457845:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120840.457848:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690e00, rc 0) 00000100:00100000:3.0:1789120840.460088:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11626:x1876028901366784:12345-192.168.206.9@tcp:101:stat.0 Request processed in 33385us (33656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120840.460107:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 156 00000001:00080000:3.0:1789120840.506015:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1789120840.506037:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789120840.506051:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1789120840.538618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120840.538765:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901367424 00000100:00100000:0.0:1789120840.538778:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901367424 00000100:00100000:0.0:1789120840.538857:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 157 00000100:00100000:0.0:1789120840.538868:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11632:x1876028901367424:12345-192.168.206.9@tcp:36:truncate.0 00010000:00010000:0.0:1789120840.538937:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120840.538969:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc0 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.538992:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120840.538998:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120840.539319:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.539354:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.539367:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120840.539419:0:5859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789120840.539444:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007c76bc7e reply state 00000000b04faca9 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120840.539453:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120840.539566:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11632:x1876028901367424:12345-192.168.206.9@tcp:36:truncate.0 Request processed in 698us (960us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789120840.539574:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 157 00000020:00080000:0.0:1789120840.539581:0:5859:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120840.541211:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541227:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541235:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541241:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120840.541246:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541256:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541272:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120840.541275:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120840.541280:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.541287:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa5867 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120840.705226:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120840.705515:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901367552 00000100:00100000:1.0:1789120840.705828:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901367552 00000100:00100000:1.0:1789120840.707760:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 158 00000100:00100000:1.0:1789120840.707788:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:11646:x1876028901367552:12345-192.168.206.9@tcp:101:stat.0 00010000:00010000:1.0:1789120840.707833:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120840.707862:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa586e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afc7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.707952:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.707969:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.707981:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708000:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708007:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708014:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708449:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708461:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.708469:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120840.708522:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789120840.708527:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120840.711952:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.711979:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.711992:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.711999:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712008:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712014:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120840.712019:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712027:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712045:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120840.712048:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120840.712053:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712059:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5875 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712102:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712108:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712114:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712119:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120840.712122:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712128:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712134:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120840.712136:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120840.712139:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712262:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa587c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712317:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa586e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 23 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712332:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 22 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.712351:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120840.712353:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120840.712356:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bae00, rc 0) 00000100:00100000:1.0:1789120840.712457:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb96d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11646:x1876028901367552:12345-192.168.206.9@tcp:101:stat.0 Request processed in 4682us (7247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120840.712468:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 158 00000100:00100000:0.0:1789120840.834322:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120840.834487:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901367808 00000100:00100000:3.0:1789120840.834500:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901367808 00000100:00100000:3.0:1789120840.834659:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 159 00000100:00100000:3.0:1789120840.834671:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11656:x1876028901367808:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120840.834698:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120840.834736:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa588a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afce expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120840.835057:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789120840.835300:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa588a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afce expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.835317:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:3.0:1789120840.835320:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120840.835335:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa588a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afce expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.835351:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691000, rc 0) 00000100:00100000:3.0:1789120840.835432:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:11656:x1876028901367808:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 764us (1123us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789120840.835440:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 159 00000100:00100000:3.0:1789120840.840191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120840.840307:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368064 00000100:00100000:2.0:1789120840.840431:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368064 00000100:00100000:2.0:1789120840.840506:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:2.0:1789120840.840517:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:11656:x1876028901368064:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120840.842446:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11656:x1876028901368064:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 1916us (2343us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789120840.842462:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:1.0:1789120840.931524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120840.931897:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368320 00000100:00100000:3.0:1789120840.931909:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368320 00000100:00100000:3.0:1789120840.932022:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 160 00000100:00100000:3.0:1789120840.932034:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11662:x1876028901368320:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120840.932066:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120840.932092:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5898 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afd5 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.932257:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.932515:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 25 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.932526:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.932571:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 25 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.932588:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 25 pid: 5858 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.932623:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922341888:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120840.932762:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8face540 going to sleep for 11 seconds 00000100:00100000:3.0:1789120840.935681:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922341888:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120840.936135:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120840.938610:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd954f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922342016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120840.938704:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120840.939457:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120840.939638:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922342016 00000100:00100000:3.0:1789120840.939649:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922342016 00000100:00100000:3.0:1789120840.939739:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120840.939751:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922342016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120840.939807:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789120840.939914:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120840.941647:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922342016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1887us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120840.941664:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789120840.941881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120840.942521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368448 00000100:00100000:3.0:1789120840.942534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368448 00010000:00010000:3.0:1789120840.942582:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 26 pid: 5858 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.942626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:3.0:1789120840.942647:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:2350:x1876028901368448:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120840.942667:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120840.942675:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 26 pid: 5858 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942713:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 26 pid: 5858 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942741:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5883 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afc7 expref: 26 pid: 5858 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942761:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120840.942767:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942778:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942830:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120840.942895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:2350:x1876028901368448:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 261us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120840.942903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00010000:00010000:3.0:1789120840.942946:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.942955:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120840.942976:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789120840.943410:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5898 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 26 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.943447:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 25 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120840.943455:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120840.943459:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120840.943462:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690000, rc 0) 00000100:00100000:3.0:1789120840.943498:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11662:x1876028901368320:12345-192.168.206.9@tcp:101:bash.0 Request processed in 11467us (11990us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789120840.943506:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 160 00000100:00100000:3.0:1789120840.945988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120840.946120:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368704 00000100:00100000:2.0:1789120840.946133:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368704 00000100:00100000:2.0:1789120840.946259:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:2.0:1789120840.946468:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11662:x1876028901368704:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789120840.946816:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120840.946837:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120840.946868:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120840.947067:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789120840.947097:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009e3c338e reply state 000000008b50eebc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120840.947108:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120840.948046:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd954f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922342016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120840.953635:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11662:x1876028901368704:12345-192.168.206.9@tcp:36:bash.0 Request processed in 7347us (7641us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789120840.953652:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 161 00000020:00080000:2.0:1789120840.953663:0:5857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120840.957671:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957697:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957706:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957713:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120840.957719:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957728:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957749:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120840.957753:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120840.957759:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.957788:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa58ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.975645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120840.975909:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368832 00000100:00100000:1.0:1789120840.975921:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368832 00000100:00100000:1.0:1789120840.975989:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:1.0:1789120840.976001:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:11662:x1876028901368832:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120840.976030:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120840.976057:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa58b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afdc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.976223:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.976240:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.976250:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.976289:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.976305:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 28 pid: 8217 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120840.976321:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d65e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922342144:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120840.976451:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789120840.982371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120840.982521:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d65e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922342144:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120840.982557:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120840.986690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901368960 00000100:00100000:3.0:1789120840.986710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901368960 00010000:00010000:0.0:1789120840.990090:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 29 pid: 8217 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120840.990187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 74 00000100:00100000:0.0:1789120840.990201:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:2350:x1876028901368960:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120840.990222:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120840.990230:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 29 pid: 8217 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990265:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 29 pid: 8217 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990294:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa589f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afd5 expref: 29 pid: 8217 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120840.990325:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990336:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990345:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120840.990372:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120840.990467:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:2350:x1876028901368960:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 271us (8111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120840.990477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 74 00010000:00010000:1.0:1789120840.991201:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.991216:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120840.991287:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789120840.991292:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120840.991328:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.991648:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa58b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afdc expref: 28 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.991672:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afdc expref: 27 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120840.991681:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120840.991684:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120840.991688:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb000, rc 0) 00000100:00100000:1.0:1789120840.991764:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:11662:x1876028901368832:12345-192.168.206.9@tcp:101:bash.0 Request processed in 15765us (16132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120840.991774:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:2.0:1789120840.998921:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120840.999088:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901369216 00000100:00100000:0.0:1789120840.999119:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901369216 00000100:00100000:0.0:1789120840.999427:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:0.0:1789120840.999441:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:11662:x1876028901369216:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:0.0:1789120840.999863:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11662:x1876028901369216:12345-192.168.206.9@tcp:35:bash.0 Request processed in 424us (954us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789120840.999872:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789120841.086890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120841.087180:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901369472 00000100:00100000:3.0:1789120841.087192:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901369472 00000100:00100000:3.0:1789120841.087579:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 163 00000100:00100000:3.0:1789120841.087592:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11672:x1876028901369472:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120841.087621:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120841.087648:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa58c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afe3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120841.087983:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1789120841.088221:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa58c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afe3 expref: 30 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.088237:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:3.0:1789120841.088250:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120841.088256:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa58c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afe3 expref: 30 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.088272:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691000, rc 0) 00000100:00100000:3.0:1789120841.088951:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11672:x1876028901369472:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1356us (2068us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1789120841.088964:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 163 00000100:00080000:1.0:1789120841.089064:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120841.098701:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120841.099661:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901369600 00000100:00100000:0.0:1789120841.099737:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901369600 00000100:00100000:0.0:1789120841.099960:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:0.0:1789120841.099980:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11672:x1876028901369600:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:0.0:1789120841.100053:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100069:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100081:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100095:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100102:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100109:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100486:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100495:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.100503:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120841.100541:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101291:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101301:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101308:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101314:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120841.101317:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101324:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101336:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120841.101338:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120841.101342:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101348:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101359:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101365:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101370:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101383:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120841.101386:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101391:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101398:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120841.101400:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120841.101402:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101407:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101420:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101426:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101432:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101565:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120841.101571:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101578:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101601:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120841.101604:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120841.101607:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.101613:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120841.101724:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11672:x1876028901369600:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1750us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120841.101733:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 164 00000100:00100000:2.0:1789120841.109379:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120841.109764:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901369856 00000100:00100000:3.0:1789120841.109776:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901369856 00000100:00100000:3.0:1789120841.109862:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:3.0:1789120841.109873:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11672:x1876028901369856:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120841.110550:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:11672:x1876028901369856:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 675us (1181us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789120841.110561:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:2.0:1789120841.194622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120841.194882:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901370112 00000100:00100000:0.0:1789120841.194895:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901370112 00000100:00100000:0.0:1789120841.194981:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:0.0:1789120841.194993:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+30:11676:x1876028901370112:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120841.195023:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120841.195051:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afea expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195481:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195500:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195513:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195530:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195547:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.195555:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.196553:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa58fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.196570:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa58fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.196581:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa58fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120841.196606:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789120841.197959:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.197976:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.197983:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.197989:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120841.197994:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198002:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198041:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120841.198044:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120841.198050:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198057:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa58ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198084:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198091:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198096:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198101:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120841.198104:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198110:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198118:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120841.198120:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120841.198123:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198129:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa58f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198308:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa58e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afea expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198325:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa58fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afea expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.198333:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:0.0:1789120841.198335:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120841.198338:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b600, rc 0) 00000100:00100000:0.0:1789120841.198450:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11676:x1876028901370112:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 3457us (3841us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789120841.198461:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 165 00000100:00100000:2.0:1789120841.201767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120841.201883:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120841.202004:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901370240 00000100:00100000:1.0:1789120841.202016:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901370240 00000100:00100000:1.0:1789120841.202117:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:1.0:1789120841.202130:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11676:x1876028901370240:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789120841.202265:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202287:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202301:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202334:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202349:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202357:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202364:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120841.202369:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202378:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202392:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:1.0:1789120841.202396:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120841.202402:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120841.202419:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120841.202513:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11676:x1876028901370240:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 386us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120841.202522:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 166 00000100:00100000:3.0:1789120841.206540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901370368 00000100:00100000:3.0:1789120841.206560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901370368 00000100:00100000:2.0:1789120841.206783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120841.206885:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901370624 00000100:00100000:1.0:1789120841.206891:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901370624 00000100:00100000:1.0:1789120841.206952:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:1.0:1789120841.206964:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11676:x1876028901370624:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789120841.207302:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11676:x1876028901370624:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 339us (524us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789120841.207312:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789120841.208023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:3.0:1789120841.208039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:2351:x1876028901370368:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120841.208057:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120841.208280:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b600/0x13cfa3d77faa58fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afea expref: 33 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.208304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120841.208311:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120841.208444:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:2351:x1876028901370368:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 410us (6560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120841.208452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120841.422900:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120841.429663:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901370880 00000100:00100000:3.0:1789120841.429685:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901370880 00000100:00100000:3.0:1789120841.429909:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:3.0:1789120841.429922:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11694:x1876028901370880:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:3.0:1789120841.430106:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120841.430393:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa590f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aff1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120841.430720:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5916 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120841.430823:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120841.430839:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120841.430874:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789120841.432071:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa590f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff1 expref: 35 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120841.432105:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff1 expref: 34 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120841.432115:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:2.0:1789120841.432118:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789120841.432122:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5c00, rc 0) 00000100:00100000:2.0:1789120841.432527:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11694:x1876028901370880:12345-192.168.206.9@tcp:101:cat.0 Request processed in 2604us (9639us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789120841.432539:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 167 00000100:00100000:1.0:1789120841.474608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120841.474809:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371008 00000100:00100000:0.0:1789120841.474822:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371008 00000100:00100000:0.0:1789120841.474894:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:0.0:1789120841.474906:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11695:x1876028901371008:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120841.474937:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120841.474964:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8aff8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.475059:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.475076:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.475090:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120841.475887:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789120841.475894:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120841.475995:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.476343:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff8 expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.476365:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff8 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.476375:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120841.476378:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120841.476383:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120841.476544:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11695:x1876028901371008:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1639us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120841.476553:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 168 00000100:00100000:3.0:1789120841.490843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120841.491306:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371392 00000100:00100000:1.0:1789120841.491319:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371392 00000100:00100000:1.0:1789120841.491394:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789120841.491407:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11695:x1876028901371392:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:1.0:1789120841.491885:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11695:x1876028901371392:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 479us (1055us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789120841.491897:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:2.0:1789120841.496704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120841.496952:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371520 00000100:00100000:3.0:1789120841.496973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371520 00000100:00100000:3.0:1789120841.497056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120841.497067:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11695:x1876028901371520:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:3.0:1789120841.497086:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789120841.497118:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa58bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afdc expref: 36 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.497209:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff1 expref: 35 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.497482:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa57bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af9d expref: 34 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.497495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7cd00) 00010000:00010000:3.0:1789120841.497525:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120841.499410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11695:x1876028901371520:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 2328us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120841.499427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120841.515676:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120841.518324:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371648 00000100:00100000:0.0:1789120841.518343:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371648 00000100:00100000:0.0:1789120841.518477:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:0.0:1789120841.518488:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11695:x1876028901371648:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:0.0:1789120841.518665:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.518685:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120841.518699:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789120841.519380:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789120841.519515:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11695:x1876028901371648:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 1024us (4783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120841.519526:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 169 00000100:00100000:1.0:1789120841.554704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120841.555124:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371776 00000100:00100000:3.0:1789120841.555165:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371776 00000100:00100000:3.0:1789120841.555248:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 170 00000100:00100000:3.0:1789120841.555261:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+33:11697:x1876028901371776:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120841.555290:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120841.555316:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8afff expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555618:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555636:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555649:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555667:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555675:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.555682:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.558897:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.558921:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559678:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120841.559832:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789120841.559838:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120841.559868:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559885:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559896:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559904:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559912:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.559919:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120841.559924:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561670:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561726:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:3.0:1789120841.561729:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120841.561856:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561865:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561892:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561898:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561905:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561911:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120841.561915:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561922:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561931:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120841.561934:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120841.561937:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.561944:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.562725:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 35 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.562926:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 34 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120841.562946:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:3.0:1789120841.562948:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120841.562952:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690000, rc 0) 00000100:00100000:3.0:1789120841.563605:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11697:x1876028901371776:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 8340us (8909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120841.563617:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 170 00010000:00010000:3.0:1789120841.966668:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120842.155915:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120842.155923:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120842.155975:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789120842.155981:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120842.156095:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922342272:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120842.156495:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120842.168382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.170639:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1b6b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922342272:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120842.170690:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901371904 00000100:00100000:0.0:1789120842.170696:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901371904 00000100:00100000:0.0:1789120842.170755:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:0.0:1789120842.170764:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11708:x1876028901371904:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789120842.170806:0:5857:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789120842.170916:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11708:x1876028901371904:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 152us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.170925:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 171 00000100:00100000:1.0:1789120842.176851:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.179275:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901372032 00000100:00100000:2.0:1789120842.179289:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901372032 00000100:00100000:2.0:1789120842.179342:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 172 00000100:00100000:2.0:1789120842.179351:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11708:x1876028901372032:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789120842.179418:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179438:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179450:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179524:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179532:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179539:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179566:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179574:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179580:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120842.179688:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789120842.179693:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120842.179708:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179720:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179726:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179733:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179749:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.179754:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179760:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179771:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:2.0:1789120842.179774:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120842.179778:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179796:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5955 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179808:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179814:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179819:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179825:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.179827:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179833:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179848:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ffd84cf3d00) 00010000:00010000:2.0:1789120842.179851:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120842.179854:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179860:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa595c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179875:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179881:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179886:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179890:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.179893:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179898:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179905:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:2.0:1789120842.179908:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120842.179910:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.179916:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.180079:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11708:x1876028901372032:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 728us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.180087:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 172 00000100:00100000:1.0:1789120842.183589:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.184579:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901372288 00000100:00100000:3.0:1789120842.184589:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901372288 00000100:00100000:3.0:1789120842.184685:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:3.0:1789120842.184694:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11708:x1876028901372288:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120842.184713:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120842.184731:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa596a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b006 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184833:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184849:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184870:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120842.184883:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789120842.184973:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184981:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184988:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.184994:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120842.184998:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185005:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185017:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:3.0:1789120842.185019:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120842.185023:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185029:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185066:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa596a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b006 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185088:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:3.0:1789120842.185091:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120842.185095:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa596a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b006 expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.185105:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691000, rc 0) 00000100:00100000:3.0:1789120842.185186:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901372288:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 493us (1605us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789120842.185194:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 173 00000100:00100000:1.0:1789120842.190037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.193753:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901372416 00000100:00100000:0.0:1789120842.193765:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901372416 00000100:00100000:0.0:1789120842.194017:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:0.0:1789120842.194028:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901372416:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789120842.194060:0:8217:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789120842.194200:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901372416:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 173us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.194208:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 174 00000100:00100000:1.0:1789120842.199636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.199838:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901372672 00000100:00100000:2.0:1789120842.199847:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901372672 00000100:00100000:2.0:1789120842.199903:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:2.0:1789120842.199913:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901372672:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120842.199934:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120842.199937:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120842.199963:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa592b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aff8 expref: 35 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.199981:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120842.199986:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120842.199999:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa597f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b00d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120842.201020:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789120842.202630:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.202650:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.202662:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.202723:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa597f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b00d expref: 37 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.202745:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b00d expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.202753:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd84cf3d00) 00010000:00010000:2.0:1789120842.202756:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120842.202759:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4200, rc 0) 00000100:00100000:2.0:1789120842.202826:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11708:x1876028901372672:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 2913us (3197us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789120842.202834:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 175 00000100:00100000:1.0:1789120842.209749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.209862:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901372928 00000100:00100000:0.0:1789120842.209870:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901372928 00000100:00100000:0.0:1789120842.210027:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:0.0:1789120842.210037:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11708:x1876028901372928:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120842.210089:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120842.210113:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4200/0x13cfa3d77faa5986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b00d expref: 36 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210127:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd84cf3d00) 00010000:00010000:0.0:1789120842.210136:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120842.210186:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210199:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210208:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210222:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210228:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210235:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210568:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210577:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210583:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210589:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120842.210593:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210600:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210610:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:0.0:1789120842.210613:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120842.210616:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210622:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5994 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210631:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210637:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210642:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210652:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120842.210655:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210660:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210668:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa045fccf (ffff9ffd9fd7cc00) 00010000:00010000:0.0:1789120842.210671:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120842.210673:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.210679:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa599b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa045fccf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.210753:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901372928:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 717us (1011us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120842.210760:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 176 00000100:00100000:1.0:1789120842.221599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.221719:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901373056 00000100:00100000:0.0:1789120842.221728:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901373056 00000100:00100000:0.0:1789120842.221791:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 177 00000100:00100000:0.0:1789120842.221802:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11708:x1876028901373056:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120842.221822:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120842.221845:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa59a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b014 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.221879:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.221914:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.221926:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.222019:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa59a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 37 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.222034:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 36 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.222042:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120842.222044:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120842.222047:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a000, rc 0) 00000100:00100000:0.0:1789120842.222104:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11708:x1876028901373056:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 304us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.222111:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 177 00000100:00100000:3.0:1789120842.225756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.227520:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901373312 00000100:00100000:1.0:1789120842.227531:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901373312 00000100:00100000:1.0:1789120842.227623:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 178 00000100:00100000:1.0:1789120842.227632:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11708:x1876028901373312:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120842.227708:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.227723:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.227734:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120842.228131:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789120842.228168:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309482023418ns, next at 310481995461ns, rc = 0 00000004:00010000:1.0:1789120842.228259:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000036dca17a reply state 000000004b87106c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.228268:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120842.228362:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11708:x1876028901373312:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 730us (2611us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789120842.228370:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 178 00010000:00010000:2.0:1789120842.231045:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231059:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231066:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231071:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.231075:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231083:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231097:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:2.0:1789120842.231103:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789120842.231107:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.231119:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa59b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.232596:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.232825:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901373440 00000100:00100000:0.0:1789120842.232834:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901373440 00000100:00100000:0.0:1789120842.232880:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 179 00000100:00100000:0.0:1789120842.232889:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:11708:x1876028901373440:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120842.232911:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120842.232930:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b01b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.232987:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.233008:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 38 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.233029:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120842.233033:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120842.233036:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b200, rc 0) 00000100:00100000:0.0:1789120842.233086:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11708:x1876028901373440:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 197us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.233092:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 179 00000100:00100000:0.0:1789120842.239418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.239495:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901373568 00000100:00100000:3.0:1789120842.239505:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901373568 00000100:00100000:3.0:1789120842.239573:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789120842.239583:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901373568:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789120842.240053:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120842.240085:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901373568:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 502us (673us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789120842.240093:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:0.0:1789120842.247003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.249589:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901373824 00000100:00100000:1.0:1789120842.249601:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901373824 00000100:00100000:0.0:1789120842.251441:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789120842.251460:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11708:x1876028901373824:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789120842.251693:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11708:x1876028901373824:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 239us (4697us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789120842.251702:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:2.0:1789120842.260516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.260583:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374080 00000100:00100000:3.0:1789120842.260592:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374080 00000100:00100000:3.0:1789120842.260648:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 180 00000100:00100000:3.0:1789120842.260658:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11708:x1876028901374080:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120842.260766:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11708:x1876028901374080:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.260783:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 180 00000040:00080000:1.0:1789120842.261206:0:12858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120842.261211:0:12858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120842.261411:0:12858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789120842.261423:0:12858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120842.267068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.267193:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374208 00000100:00100000:1.0:1789120842.267203:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374208 00000100:00100000:1.0:1789120842.267255:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 181 00000100:00100000:1.0:1789120842.267264:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11708:x1876028901374208:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120842.267284:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120842.267305:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b022 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267385:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267398:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267407:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120842.267444:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120842.267462:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267487:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b022 expref: 41 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267504:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b022 expref: 40 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.267512:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:1.0:1789120842.267515:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789120842.267531:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120842.267585:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11708:x1876028901374208:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 322us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120842.267591:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 181 00000100:00100000:0.0:1789120842.271711:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.271779:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374336 00000100:00100000:2.0:1789120842.271797:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374336 00000100:00100000:2.0:1789120842.271849:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789120842.271858:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901374336:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120842.271874:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120842.271892:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b029 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120842.271915:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d149, blocks: 0x1 00010000:00010000:2.0:1789120842.271934:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1789120842.271939:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120842.271947:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.271962:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 8 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.271975:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4000, rc 0) 00000100:00100000:2.0:1789120842.272027:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901374336:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 170us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.272034:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:3.0:1789120842.278392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.278428:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374592 00000100:00100000:3.0:1789120842.278437:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374592 00000100:00100000:3.0:1789120842.278490:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 182 00000100:00100000:3.0:1789120842.278500:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11708:x1876028901374592:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120842.278594:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11708:x1876028901374592:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.278602:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 182 00000100:00100000:2.0:1789120842.284971:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120842.285068:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374720 00000100:00100000:0.0:1789120842.285077:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374720 00000100:00100000:0.0:1789120842.285428:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:0.0:1789120842.285439:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:11708:x1876028901374720:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120842.285457:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120842.285475:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b030 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.285511:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.285519:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120842.285523:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120842.285528:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.285558:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.285572:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.285586:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6706:1876028922342400:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120842.285706:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd87214a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789120842.295844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.295955:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafee5680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6706:1876028922342400:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120842.295986:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.296005:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b600, rc 0) 00000100:00100000:2.0:1789120842.296191:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb59a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:11708:x1876028901374720:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 10754us (11291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.296201:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:3.0:1789120842.296572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374848 00000100:00100000:3.0:1789120842.296579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374848 00010000:00010000:3.0:1789120842.296610:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.296646:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:3.0:1789120842.296655:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901374848:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120842.296667:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120842.296689:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.296700:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.296723:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d73b337/0x13cfa3d77faa59cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b029 expref: 9 pid: 8216 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.296744:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120842.296747:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120842.296755:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.296765:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.296807:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.296822:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c5b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922342528:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789120842.296877:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120842.306919:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c5b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922342528:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789120842.306943:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120842.306989:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901374848:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 10334us (11153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.307000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:0.0:1789120842.313446:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.313554:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901374976 00000100:00100000:1.0:1789120842.313563:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901374976 00002000:00100000:1.0:1789120842.313609:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ffc83460780 x1876028901374976/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:373/0 lens 504/0 e 0 to 0 dl 1789120853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120842.313620:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc83460780 with x1876028901374976 ext(0->8) 00002000:00010000:1.0:1789120842.313626:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc83460780 00000100:00100000:1.0:1789120842.313682:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:1.0:1789120842.313691:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901374976:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789120842.314090:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2349:x1876028901374976:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 400us (650us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789120842.314098:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00002000:00100000:1.0:1789120842.314105:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ffc83460780 x1876028901374976/t4294967314(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:373/0 lens 504/448 e 0 to 0 dl 1789120853 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120842.314113:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffc83460780 with x1876028901374976 ext(0->8) 00002000:00010000:1.0:1789120842.314117:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffc83460780 00000100:00100000:1.0:1789120842.321539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.321611:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901375104 00000100:00100000:3.0:1789120842.321620:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901375104 00000100:00100000:3.0:1789120842.321675:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 183 00000100:00100000:3.0:1789120842.321685:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11708:x1876028901375104:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789120842.414744:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789120842.414776:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789120842.414821:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789120842.414942:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789120842.414951:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789120842.414965:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922342656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789120842.415023:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120842.415092:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922342656 00000100:00100000:2.0:1789120842.415099:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922342656 00000100:00100000:2.0:1789120842.415170:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789120842.415178:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922342656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789120842.415318:0:8216:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789120842.415322:0:8216:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789120842 00002000:00010000:2.0:1789120842.415324:0:8216:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789120842.415326:0:8216:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789120841 -> 1789120842 00002000:00010000:2.0:1789120842.415328:0:8216:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789120842.415380:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922342656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (356us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789120842.415387:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789120842.415421:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789120842.415453:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb59a8b40/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789120842.415459:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb59a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922342656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789120842.425620:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11708:x1876028901375104:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 97412us (97564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.425659:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 183 00000100:00100000:3.0:1789120842.429595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.429631:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901375232 00000100:00100000:3.0:1789120842.429639:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901375232 00000100:00100000:3.0:1789120842.429685:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:3.0:1789120842.429694:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2351:x1876028901375232:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789120842.475381:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922342912:0@lo:400:kworker.0 00000100:00100000:1.0:1789120842.475447:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120842.475505:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120842.475511:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922343040:0@lo:400:kworker.0 00000100:00100000:1.0:1789120842.475533:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120842.475577:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922342912 00000100:00100000:1.0:1789120842.475584:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922342912 00000100:00100000:1.0:1789120842.475618:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922343040 00000100:00100000:1.0:1789120842.475620:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922343040 00000100:00100000:1.0:1789120842.475648:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789120842.475655:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922342912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.476023:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922342784:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.476059:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120842.476085:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922343296:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.476109:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120842.476126:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120842.476131:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922343168:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.476170:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120842.476396:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922342912:12345-0@lo:400:kworker.0 Request processed in 739us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120842.476404:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789120842.476424:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922343168 00000100:00100000:1.0:1789120842.476428:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922343168 00000100:00100000:1.0:1789120842.476448:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789120842.476455:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922343040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120842.476488:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922343040:12345-0@lo:400:kworker.0 Request processed in 34us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120842.476494:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789120842.476506:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789120842.476512:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922343168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120842.476538:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922343168:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120842.476544:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789120842.477022:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922343040:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.477036:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922342912:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.477074:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922343168:0@lo:400:kworker.0 00000100:00080000:2.0:1789120842.477190:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120842.477204:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922342784 00000100:00100000:2.0:1789120842.477209:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922342784 00000100:00100000:2.0:1789120842.477242:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789120842.477250:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922342784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120842.477298:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd900e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922342784:12345-0@lo:400:kworker.0 Request processed in 48us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.477304:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789120842.477333:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922343296 00000100:00100000:2.0:1789120842.477343:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922343296 00000100:00100000:2.0:1789120842.477373:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120842.477379:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922343296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120842.477408:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922343296:12345-0@lo:400:kworker.0 Request processed in 29us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.477414:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789120842.477463:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120842.477488:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922342784:0@lo:400:kworker.0 00000100:00100000:2.0:1789120842.477498:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1789120842.477502:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1789120842.477524:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdc1e6ed00, transno 4294967307 00000100:00100000:2.0:1789120842.477544:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922343296:0@lo:400:kworker.0 00000100:00100000:3.0:1789120842.478436:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120842.478479:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120842.478609:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922343424 00000100:00100000:2.0:1789120842.478615:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922343424 00000100:00100000:2.0:1789120842.478656:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120842.478674:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922343424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120842.478758:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120842.478814:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922343424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.478822:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120842.479096:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922343424:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789120842.511853:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1789120842.511873:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789120842.512023:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901375232:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 82325us (82431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.512035:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:0.0:1789120842.516809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.517116:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901375488 00000100:00100000:1.0:1789120842.517126:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901375488 00000100:00100000:1.0:1789120842.517223:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 184 00000100:00100000:1.0:1789120842.517232:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11708:x1876028901375488:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120842.517305:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120842.517331:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa59c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b022 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.517350:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:1.0:1789120842.517356:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120842.517384:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.517397:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.517406:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120842.517626:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e859e842 reply state 000000009b954119 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.517635:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120842.517724:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11708:x1876028901375488:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 492us (923us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789120842.517732:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 184 00010000:00010000:0.0:1789120842.519972:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.519989:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.519996:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.520016:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120842.520021:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.520030:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.520045:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120842.520049:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120842.520053:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.520059:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa59da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.520491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.520793:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901375616 00000100:00100000:2.0:1789120842.520802:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901375616 00000100:00100000:2.0:1789120842.520857:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:2.0:1789120842.520867:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901375616:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789120842.521106:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789120842.521110:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789120842 -> 1789120840 00002000:00010000:2.0:1789120842.521112:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789120839 00002000:00010000:2.0:1789120842.521115:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789120842 -> 1789120840 00002000:00010000:2.0:1789120842.521118:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789120842.521197:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2351:x1876028901375616:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 330us (708us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789120842.521205:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:1.0:1789120842.524644:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.524835:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901375872 00000100:00100000:3.0:1789120842.524844:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901375872 00000100:00100000:3.0:1789120842.524902:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 185 00000100:00100000:3.0:1789120842.524912:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11708:x1876028901375872:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789120842.524972:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.525000:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.525008:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.525039:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 18 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.525052:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 18 pid: 5859 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.525066:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922343552:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120842.525176:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120842.529272:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922343552:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120842.529297:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.530322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.530475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376000 00000100:00100000:3.0:1789120842.530483:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376000 00010000:00010000:3.0:1789120842.530518:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 19 pid: 5859 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.530553:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:3.0:1789120842.530561:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:2349:x1876028901376000:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120842.530573:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120842.530590:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 19 pid: 5859 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530602:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 19 pid: 5859 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530622:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a000/0x13cfa3d77faa59a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b014 expref: 19 pid: 5859 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530636:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:3.0:1789120842.530641:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530649:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530657:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.530681:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120842.530796:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530804:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530840:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530847:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530853:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530859:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120842.530863:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530871:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530880:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:1.0:1789120842.530883:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789120842.530886:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.530892:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa59e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.531031:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:2349:x1876028901376000:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 469us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.531040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:1.0:1789120842.531139:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:11708:x1876028901375872:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 6228us (6503us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789120842.531239:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 185 00000100:00100000:2.0:1789120842.539565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.539661:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376128 00000100:00100000:3.0:1789120842.539674:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376128 00000100:00100000:3.0:1789120842.539744:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:3.0:1789120842.539755:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb99cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2352:x1876028901376128:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789120842.539807:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.539846:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.539854:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120842.539859:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120842.539864:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.539900:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.539913:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 8 pid: 6706 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.539926:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922343680:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120842.540019:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120842.544692:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922343680:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120842.544799:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.550472:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.550604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376256 00000100:00100000:3.0:1789120842.550614:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376256 00010000:00010000:3.0:1789120842.550650:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120842.550806:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:3.0:1789120842.550816:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5532940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901376256:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120842.550829:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120842.550850:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.550863:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.550886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa59d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b030 expref: 9 pid: 6706 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.550900:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120842.550905:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120842.550910:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.550919:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.551099:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120842.551200:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5532940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2350:x1876028901376256:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 385us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120842.551210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00010000:00010000:0.0:1789120842.551561:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.551571:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551851:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551872:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551880:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551887:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120842.551891:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551900:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551913:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.551921:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004783224e/0x13cfa3d77faa59e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.552068:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb99cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901376128:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 12314us (12510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120842.552076:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:2.0:1789120842.555139:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120842.555384:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376512 00000100:00100000:1.0:1789120842.555393:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376512 00000100:00100000:1.0:1789120842.555449:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 186 00000100:00100000:1.0:1789120842.555473:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5531a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+17:11708:x1876028901376512:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789120842.555544:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555560:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555571:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555843:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555854:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555861:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555890:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.555903:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 18 pid: 5857 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.555915:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922343808:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120842.556379:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120842.559378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.559534:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922343808:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120842.559556:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.559598:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376640 00000100:00100000:2.0:1789120842.559614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376640 00010000:00010000:2.0:1789120842.559641:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 19 pid: 5857 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.559670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:2.0:1789120842.559678:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:2350:x1876028901376640:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120842.559691:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120842.559698:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 19 pid: 5857 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559709:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 19 pid: 5857 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559731:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa59b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b01b expref: 19 pid: 5857 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559746:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:2.0:1789120842.559751:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559760:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.559931:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120842.559956:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120842.559962:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.559985:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:2350:x1876028901376640:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 307us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.560001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000001:00080000:3.0:1789120842.560372:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789120842.560628:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789120842.560698:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789120842.561027:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922343936:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789120842.561075:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120842.561109:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789120842.561133:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922343936 00000100:00100000:0.0:1789120842.561140:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922343936 00000100:00100000:0.0:1789120842.561276:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120842.561291:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8217:x1876028922343936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789120842.561379:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8217:x1876028922343936:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.561402:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120842.561473:0:8217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789120842.561479:0:8217:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb59a8b40, transno 4294967315 00000100:00100000:3.0:1789120842.561500:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922343936:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789120842.563059:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789120842.563139:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5532580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922344064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789120842.563460:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120842.563537:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd957819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120842.563581:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922344064 00000100:00100000:0.0:1789120842.563587:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922344064 00000100:00100000:0.0:1789120842.563665:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120842.563674:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5530b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1876028922344064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789120842.563894:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5530b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8217:x1876028922344064:12345-0@lo:1000:mdt00_003.0 Request processed in 221us (434us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789120842.563902:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120842.563996:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5532580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922344064:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789120842.564047:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564057:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564065:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564071:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120842.564076:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564083:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564098:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:1.0:1789120842.564101:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120842.564105:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564112:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa59f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564379:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564387:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564393:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564407:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120842.564411:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564418:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564427:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:1.0:1789120842.564429:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120842.564433:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564439:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b400/0x13cfa3d77faa5932 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564458:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564470:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564478:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564504:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.564517:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 21 pid: 8217 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120842.564538:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922344192:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120842.564605:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120842.571040:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922344192:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120842.571070:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.572360:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120842.572860:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901376768 00000100:00100000:3.0:1789120842.572868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901376768 00010000:00010000:3.0:1789120842.573438:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 22 pid: 8217 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.573658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:0.0:1789120842.573670:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:2350:x1876028901376768:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120842.573686:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120842.573693:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 22 pid: 8217 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573774:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 22 pid: 8217 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573806:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa594e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8afff expref: 22 pid: 8217 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573821:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:0.0:1789120842.573825:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573835:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573855:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.573881:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120842.573921:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573932:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573945:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573952:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573959:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573966:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.573971:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.573978:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574000:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:2.0:1789120842.574003:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120842.574007:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574013:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa59fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574026:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574032:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574038:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574044:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120842.574048:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.574051:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:2350:x1876028901376768:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 382us (1694us total) trans 0 rc 0/0 00010000:00010000:2.0:1789120842.574059:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120842.574066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00010000:00010000:2.0:1789120842.574075:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd9fd7c300) 00010000:00010000:2.0:1789120842.574079:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120842.574082:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120842.574089:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa59ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120842.574452:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5531a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11708:x1876028901376512:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 18981us (19324us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789120842.574471:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 186 00000020:00080000:2.0:1789120842.574476:0:8217:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789120842.574599:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120842.574603:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120842.575253:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789120842.575262:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789120842.579011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120842.579092:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377024 00000100:00100000:2.0:1789120842.579102:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377024 00000100:00100000:0.0:1789120842.579213:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:0.0:1789120842.579226:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11708:x1876028901377024:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789120842.579920:0:5860:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789120842.580031:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789120842.580073:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580089:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580099:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580108:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580115:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580131:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120842.580176:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789120842.580267:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11708:x1876028901377024:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1043us (1263us total) trans 4294967468 rc 0/0 00010000:00010000:1.0:1789120842.581201:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120842.581210:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.581220:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4be00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120842.581224:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.581232:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.581246:0:12067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ffd9fd7cc00) 00010000:00010000:1.0:1789120842.581249:0:12067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789120842.581254:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.581260:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4be00/0x13cfa3d77faa5a04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120842.581279:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120842.581281:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120842.581283:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120842.585816:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000020:00080000:0.0:1789120842.585829:0:5860:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789120842.988897:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120843.187419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120843.187456:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120843.187492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120843.187771:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377152 00000100:00100000:0.0:1789120843.187789:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377152 00000100:00100000:0.0:1789120843.187838:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 320 00000100:00100000:0.0:1789120843.187847:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901377152:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120843.187914:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2350:x1876028901377152:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 69us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120843.187921:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 320 00000100:00100000:1.0:1789120843.188188:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377280 00000100:00100000:1.0:1789120843.188193:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377280 00000100:00100000:1.0:1789120843.188232:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:1.0:1789120843.188239:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5531e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901377280:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120843.188278:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5531e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2350:x1876028901377280:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 40us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120843.188284:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00080000:2.0:1789120843.188442:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120843.189434:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377408 00000100:00100000:3.0:1789120843.189443:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377408 00000100:00100000:3.0:1789120843.189516:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00100000:3.0:1789120843.189525:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2350:x1876028901377408:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120843.189586:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+5:2350:x1876028901377408:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 62us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120843.189604:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 147 00000100:00080000:2.0:1789120843.190678:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120844.011357:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789120844.132047:0:12909:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120844.132055:0:12909:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120844.132197:0:12909:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789120844.132204:0:12909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120844.215993:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.216123:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377664 00000100:00100000:2.0:1789120844.216135:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377664 00000100:00100000:2.0:1789120844.216242:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 187 00000100:00100000:2.0:1789120844.216254:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:11726:x1876028901377664:12345-192.168.206.9@tcp:101:lfs.0 00000100:00080000:3.0:1789120844.216285:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120844.216295:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.216323:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b037 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.216652:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5a12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.216670:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.216683:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120844.216706:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1789120844.216928:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b037 expref: 25 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.216946:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b037 expref: 24 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.216955:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120844.216958:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789120844.216963:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4e00, rc 0) 00000100:00100000:2.0:1789120844.217057:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11726:x1876028901377664:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 805us (1076us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789120844.217066:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 187 00000100:00100000:3.0:1789120844.221418:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.221622:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901377792 00000100:00100000:1.0:1789120844.221634:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901377792 00000100:00100000:1.0:1789120844.221706:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:1.0:1789120844.221717:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11726:x1876028901377792:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:1.0:1789120844.221826:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.221867:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.221941:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.222003:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.222043:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.222052:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.222994:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223009:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223031:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120844.223122:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223165:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223183:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223191:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223198:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.223202:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223210:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223224:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120844.223227:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.223232:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223239:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223252:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223265:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223270:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223289:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.223293:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223308:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223318:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.223320:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.223341:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223348:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223374:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223394:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223408:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223413:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.223436:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223444:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223452:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120844.223464:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.223468:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.223474:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.224304:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11726:x1876028901377792:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 2582us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.224316:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 188 00000100:00100000:3.0:1789120844.277304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.277767:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901378048 00000100:00100000:1.0:1789120844.277791:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901378048 00000100:00100000:1.0:1789120844.277879:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:1.0:1789120844.277891:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11729:x1876028901378048:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120844.277916:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120844.277954:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b03e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278044:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278061:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278085:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278103:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278110:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278117:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278534:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278545:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278552:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120844.278565:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789120844.278919:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278986:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.278994:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279000:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.279012:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279020:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279034:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120844.279037:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.279042:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279049:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279061:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279068:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279074:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279080:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.279083:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279089:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279095:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120844.279097:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.279107:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279112:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa5a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279227:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 27 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279243:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 26 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.279251:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.279254:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120844.279256:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb400, rc 0) 00000100:00100000:1.0:1789120844.279384:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11729:x1876028901378048:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1494us (2092us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789120844.279395:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 189 00000100:00100000:2.0:1789120844.287592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.287677:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901378176 00000100:00100000:1.0:1789120844.287688:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901378176 00000100:00100000:1.0:1789120844.287760:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:1.0:1789120844.287781:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11729:x1876028901378176:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789120844.287879:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.287899:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.287913:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288492:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288500:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288508:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288515:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.288519:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288527:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288540:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.288545:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120844.288550:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.288557:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.288653:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11729:x1876028901378176:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 881us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.288663:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 190 00000100:00100000:2.0:1789120844.293466:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120844.297581:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901378432 00000100:00100000:0.0:1789120844.297602:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901378432 00000100:00100000:2.0:1789120844.300238:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:2.0:1789120844.300254:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11729:x1876028901378432:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120844.300835:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:11729:x1876028901378432:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 582us (7380us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789120844.301413:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:3.0:1789120844.347802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.350188:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901378688 00000100:00100000:1.0:1789120844.350205:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901378688 00000100:00100000:1.0:1789120844.350283:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 191 00000100:00100000:1.0:1789120844.350304:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:11255:x1876028901378688:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120844.350333:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120844.350357:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b045 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.352614:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.352646:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.352655:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.352705:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.352725:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 28 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.352743:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922344320:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120844.352893:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120844.366551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.366617:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922344320:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120844.366650:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.366683:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901378816 00000100:00100000:1.0:1789120844.366698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901378816 00010000:00010000:1.0:1789120844.366739:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 29 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.366798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:0.0:1789120844.366806:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789120844.366811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:2349:x1876028901378816:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120844.366829:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120844.366837:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 29 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.366850:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 29 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.366875:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b03e expref: 29 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120844.366883:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789120844.366893:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.366899:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.366910:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.366918:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.366952:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120844.367019:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:2349:x1876028901378816:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 211us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.367035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00010000:00010000:0.0:1789120844.367794:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120844.367805:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120844.367828:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789120844.368011:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa5a5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 29 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120844.368043:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 28 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120844.368053:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:0.0:1789120844.368056:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789120844.368059:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bbe00, rc 0) 00000100:00100000:0.0:1789120844.368099:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11255:x1876028901378688:12345-192.168.206.9@tcp:101:bash.0 Request processed in 17798us (20312us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789120844.368107:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 191 00000100:00100000:2.0:1789120844.374204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.374251:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379072 00000100:00100000:2.0:1789120844.374264:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379072 00000100:00100000:2.0:1789120844.374379:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 192 00000100:00100000:2.0:1789120844.374394:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5530780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11255:x1876028901379072:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789120844.375067:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.375089:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.375103:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120844.375222:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789120844.375250:0:5858:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000049d4a393 reply state 00000000e022ee6c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.375260:0:5858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789120844.375311:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789120844.375572:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5530780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11255:x1876028901379072:12345-192.168.206.9@tcp:36:bash.0 Request processed in 1114us (1314us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789120844.375581:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 192 00000020:00080000:2.0:1789120844.375588:0:5858:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789120844.378476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:2.0:1789120844.378548:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378564:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378572:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378579:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.378584:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378613:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378632:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120844.378636:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.378642:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.378649:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5a74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120844.378865:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379200 00000100:00100000:3.0:1789120844.378877:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379200 00000100:00100000:3.0:1789120844.379013:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:3.0:1789120844.379025:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:11255:x1876028901379200:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120844.379054:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120844.379074:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b04c expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.379165:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b04c expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.379180:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b04c expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.379202:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120844.379206:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120844.379216:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690400, rc 0) 00000100:00100000:3.0:1789120844.379286:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11255:x1876028901379200:12345-192.168.206.9@tcp:101:bash.0 Request processed in 263us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120844.379294:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 193 00000100:00100000:1.0:1789120844.381961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.382116:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379328 00000100:00100000:2.0:1789120844.382128:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379328 00000100:00100000:2.0:1789120844.382244:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:2.0:1789120844.382254:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:11255:x1876028901379328:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120844.382275:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.382297:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b053 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120844.382327:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3d148, atime: 0x6aa3d147, ctime: 0x6aa3d148, blocks: 0xb 00010000:00010000:2.0:1789120844.382351:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1789120844.382357:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120844.382366:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.382383:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.382420:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4200, rc 0) 00000100:00080000:3.0:1789120844.382466:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120844.382480:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:11255:x1876028901379328:12345-192.168.206.9@tcp:101:bash.0 Request processed in 228us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.382489:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:2.0:1789120844.384823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.384984:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379456 00000100:00100000:1.0:1789120844.384996:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379456 00002000:00010000:1.0:1789120844.385041:0:6712:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789120844.385046:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb55303c0 with x1876028901379456 ext(0->18446744073709551615) 00002000:00010000:1.0:1789120844.385060:0:6712:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb55303c0. 00000100:00100000:1.0:1789120844.385095:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120844.385110:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2351:x1876028901379456:12345-192.168.206.9@tcp:10:bash.0 00002000:00010000:1.0:1789120844.385462:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789120844.385466:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789120840 -> 1789120844 00002000:00010000:1.0:1789120844.385470:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789120839 -> 1789120839 00002000:00010000:1.0:1789120844.385472:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789120840 -> 1789120844 00002000:00010000:1.0:1789120844.385475:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789120844.385762:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2351:x1876028901379456:12345-192.168.206.9@tcp:10:bash.0 Request processed in 653us (947us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789120844.385781:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00002000:00010000:1.0:1789120844.385786:0:6712:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789120844.385789:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb55303c0 with x1876028901379456 ext(0->18446744073709551615) 00002000:00010000:1.0:1789120844.385793:0:6712:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb55303c0. 00000100:00100000:0.0:1789120844.430457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.430583:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379584 00000100:00100000:1.0:1789120844.430596:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379584 00000100:00100000:1.0:1789120844.430670:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 194 00000100:00100000:1.0:1789120844.430683:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11743:x1876028901379584:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:1.0:1789120844.430783:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.430820:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.430834:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.430866:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.430875:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.430883:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431251:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431261:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431268:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120844.431373:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431387:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431394:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431412:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431419:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.431424:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431432:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431445:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120844.431449:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.431454:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431460:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431474:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431480:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431486:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431492:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.431495:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431513:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431521:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f700) 00010000:00010000:1.0:1789120844.431523:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.431526:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431532:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5a90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431549:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431555:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431561:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431566:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.431569:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431575:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431582:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.431585:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.431588:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.431604:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.431700:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11743:x1876028901379584:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 1019us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.431709:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 194 00000100:00100000:0.0:1789120844.465301:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120844.467202:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379840 00000100:00100000:3.0:1789120844.467220:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379840 00000100:00100000:3.0:1789120844.467307:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:3.0:1789120844.467319:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+32:11746:x1876028901379840:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120844.467347:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120844.467374:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5a9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b05a expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467467:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467484:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467497:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467648:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467658:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.467666:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469490:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469511:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469524:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120844.469537:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789120844.469654:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469663:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469670:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469677:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120844.469682:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469691:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469705:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:3.0:1789120844.469708:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120844.469714:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469734:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469752:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469758:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469764:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469768:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120844.469781:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469788:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469796:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd831cf100) 00010000:00010000:3.0:1789120844.469799:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120844.469802:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469808:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469864:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5a9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b05a expref: 35 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469879:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b05a expref: 34 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.469892:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120844.469895:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789120844.469898:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691c00, rc 0) 00000100:00100000:3.0:1789120844.471385:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11746:x1876028901379840:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 4056us (6086us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789120844.471408:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 195 00000100:00100000:3.0:1789120844.478927:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.479077:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901379968 00000100:00100000:2.0:1789120844.479090:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901379968 00000100:00100000:2.0:1789120844.479221:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 196 00000100:00100000:2.0:1789120844.479233:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1c5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11746:x1876028901379968:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:2.0:1789120844.479344:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.479363:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 34 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.479373:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.479418:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 34 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.479435:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 34 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.479454:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922344448:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120844.479752:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd855e2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120844.485212:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922344448:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120844.485255:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120844.485694:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.487561:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901380224 00000100:00100000:2.0:1789120844.487578:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901380224 00000100:00100000:2.0:1789120844.487656:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:2.0:1789120844.487668:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:10708:x1876028901380224:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120844.488209:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:10708:x1876028901380224:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 541us (2514us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789120844.488218:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:0.0:1789120844.491878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120844.492088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901380352 00000100:00100000:3.0:1789120844.492100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901380352 00010000:00010000:3.0:1789120844.492224:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 36 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120844.492330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:3.0:1789120844.492342:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:2349:x1876028901380352:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120844.492360:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120844.492368:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 36 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492384:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 36 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492411:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5a66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b045 expref: 36 pid: 5859 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492430:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120844.492452:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492463:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492472:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.492616:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120844.492685:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:2349:x1876028901380352:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 343us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120844.492694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00010000:00010000:2.0:1789120844.492766:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492786:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492822:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492830:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492837:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492844:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.492849:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492871:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492895:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120844.492898:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120844.492903:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.492909:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.492956:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1c5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11746:x1876028901379968:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 13725us (14044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.492964:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 196 00000100:00100000:0.0:1789120844.495432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.495578:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901380608 00000100:00100000:2.0:1789120844.495589:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901380608 00000100:00100000:2.0:1789120844.495681:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:2.0:1789120844.495694:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+34:11746:x1876028901380608:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120844.496106:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11746:x1876028901380608:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 414us (685us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789120844.496114:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:0.0:1789120844.604477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.604740:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901380864 00000100:00100000:1.0:1789120844.604754:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901380864 00000100:00100000:1.0:1789120844.604841:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:1.0:1789120844.604852:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+35:11757:x1876028901380864:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:1.0:1789120844.604882:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120844.604907:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5ac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b061 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605006:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605025:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605038:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605056:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605063:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605092:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605770:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5add lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605793:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.605801:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120844.605812:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789120844.605923:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606255:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606263:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606270:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.606275:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606283:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606297:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120844.606300:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.606315:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606384:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606400:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606406:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606413:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606419:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.606422:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606429:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606437:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f700) 00010000:00010000:1.0:1789120844.606440:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.606443:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606449:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5ad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606752:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5ac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b061 expref: 38 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606795:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b061 expref: 37 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.606803:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.606806:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120844.606809:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120844.607012:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:11757:x1876028901380864:12345-192.168.206.9@tcp:101:cat.0 Request processed in 2160us (2558us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789120844.607023:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 197 00000100:00100000:0.0:1789120844.613192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120844.613424:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901381120 00000100:00100000:3.0:1789120844.613437:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901381120 00000100:00100000:3.0:1789120844.613560:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:3.0:1789120844.613572:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:11757:x1876028901381120:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:3.0:1789120844.613879:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11757:x1876028901381120:12345-192.168.206.9@tcp:35:cat.0 Request processed in 308us (737us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789120844.613888:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 54 00000100:00100000:0.0:1789120844.634140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.634422:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901381376 00000100:00100000:1.0:1789120844.634435:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901381376 00000100:00100000:1.0:1789120844.634518:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 198 00000100:00100000:1.0:1789120844.634530:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11758:x1876028901381376:12345-192.168.206.9@tcp:36:rm.0 00010000:00010000:1.0:1789120844.634606:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789120844.634643:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5add lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b061 expref: 38 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634670:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b05a expref: 37 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634686:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b04c expref: 36 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634699:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120844.634713:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120844.634878:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634904:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634916:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634932:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634939:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.634946:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.635590:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.635601:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.635609:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120844.637819:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789120844.637837:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311891692829ns, next at 312891688201ns, rc = 0 00010000:00010000:1.0:1789120844.637988:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638005:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638025:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638035:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638042:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638048:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.638345:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120844.638354:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.638362:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120844.638366:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.638387:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.638401:0:12067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:2.0:1789120844.638404:0:12067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120844.638409:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.638418:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120844.638420:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120844.638422:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120844.638587:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789120844.638594:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638633:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638639:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638645:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638650:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.638654:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638659:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638680:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120844.638682:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789120844.638685:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638690:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5af9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638713:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638845:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638852:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638857:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.638861:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638867:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638876:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120844.638879:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120844.638882:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.638949:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bac00/0x13cfa3d77faa5aeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120844.638971:0:5857:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b550b305 reply state 000000004df596c9 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.638982:0:5857:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120844.639246:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+37:11758:x1876028901381376:12345-192.168.206.9@tcp:36:rm.0 Request processed in 4712us (5114us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789120844.639256:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 198 00010000:00010000:2.0:1789120844.643598:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643620:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643629:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643636:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.643642:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643651:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643672:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f700) 00010000:00010000:2.0:1789120844.643676:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.643682:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.643707:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5af2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789120844.650583:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120844.650594:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120844.650834:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789120844.650843:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120844.697755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120844.697919:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901381632 00000100:00100000:3.0:1789120844.697931:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901381632 00000100:00100000:3.0:1789120844.698007:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 199 00000100:00100000:3.0:1789120844.698020:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+36:11764:x1876028901381632:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120844.698052:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120844.698133:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5b07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b068 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698618:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698647:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698657:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698669:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698674:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.698678:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120844.699899:0:8217:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789120844.700374:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700392:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700404:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700449:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700458:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700562:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700569:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.700574:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700582:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700597:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120844.700600:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.700607:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700629:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691000/0x13cfa3d77faa5b0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120844.700648:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000674ee473 reply state 0000000051863bf5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.700656:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789120844.700688:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690e00/0x13cfa3d77faa5b07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 39 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700700:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 38 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.700706:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.700708:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120844.700710:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5e00, rc 0) 00000100:00100000:2.0:1789120844.700817:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11764:x1876028901381632:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2799us (3076us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789120844.700827:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 199 00010000:00010000:2.0:1789120844.702507:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702526:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702533:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702539:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.702561:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702571:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702588:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd831cf100) 00010000:00010000:2.0:1789120844.702591:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.702596:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.702603:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690000/0x13cfa3d77faa5b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120844.703664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.703810:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901381760 00000100:00100000:1.0:1789120844.703823:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901381760 00000100:00100000:1.0:1789120844.703888:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:1.0:1789120844.703900:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901381760:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120844.703923:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120844.703955:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b06f expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120844.703991:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789120844.704015:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=311s v=(0 0) 00010000:00010000:1.0:1789120844.704020:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120844.704030:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.704056:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 6 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.704070:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bac00, rc 0) 00000100:00100000:1.0:1789120844.704171:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2349:x1876028901381760:12345-192.168.206.9@tcp:101:bash.0 Request processed in 243us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.704194:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:0.0:1789120844.706035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.706088:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901381888 00000100:00100000:1.0:1789120844.706098:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901381888 00000100:00100000:2.0:1789120844.706241:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:2.0:1789120844.706254:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:11764:x1876028901381888:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120844.706275:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.706324:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b076 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.706364:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.706374:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120844.706378:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120844.706384:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.706426:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.706464:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.706482:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1876028922344576:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120844.706629:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd855e2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120844.708683:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6705:1876028922344576:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120844.708732:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.708765:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4000, rc 0) 00000100:00100000:2.0:1789120844.708835:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:11764:x1876028901381888:12345-192.168.206.9@tcp:101:bash.0 Request processed in 2583us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.708845:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:0.0:1789120844.711140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.711255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901382016 00000100:00100000:2.0:1789120844.711267:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901382016 00010000:00010000:2.0:1789120844.711313:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.711410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:2.0:1789120844.711421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901382016:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120844.711438:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120844.711462:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.711489:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.711517:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a595289/0x13cfa3d77faa5b2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b06f expref: 7 pid: 8216 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.711536:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120844.711541:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120844.711555:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.711567:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.711610:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.711626:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5844:1876028922344704:192.168.206.9@tcp:105: 00000100:00100000:2.0:1789120844.711755:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd855e2240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120844.714907:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5531680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5844:1876028922344704:192.168.206.9@tcp:105: 00010000:00010000:2.0:1789120844.714940:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120844.715021:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901382016:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 3600us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.715035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:0.0:1789120844.715108:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.715281:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901382272 00000100:00100000:2.0:1789120844.715289:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901382272 00000100:00100000:2.0:1789120844.715334:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:2.0:1789120844.715343:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+38:11764:x1876028901382272:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789120844.715719:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb9505680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11764:x1876028901382272:12345-192.168.206.9@tcp:35:bash.0 Request processed in 375us (611us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789120844.715726:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 55 00000100:00100000:3.0:1789120844.786929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.787185:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901382400 00000100:00100000:2.0:1789120844.787198:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901382400 00000100:00100000:2.0:1789120844.787271:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 200 00000100:00100000:2.0:1789120844.787282:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+39:11780:x1876028901382400:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120844.787325:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.787353:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b07d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787435:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787453:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787470:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120844.787545:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1789120844.787549:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120844.787580:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787611:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b07d expref: 41 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787647:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b07d expref: 40 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.787656:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120844.787660:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120844.787664:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5c00, rc 0) 00000100:00100000:2.0:1789120844.787749:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11780:x1876028901382400:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 469us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.787757:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 200 00000100:00100000:0.0:1789120844.792693:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.794230:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901382656 00000100:00100000:1.0:1789120844.794248:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901382656 00000100:00100000:1.0:1789120844.794408:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:1.0:1789120844.794420:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+40:11780:x1876028901382656:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120844.794447:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120844.794475:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b084 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.794602:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.794618:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.794743:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.794800:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.794816:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 41 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.794833:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922344832:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120844.794995:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120844.797503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.797524:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922344832:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120844.797557:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.798426:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901382784 00000100:00100000:2.0:1789120844.798437:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901382784 00010000:00010000:2.0:1789120844.798485:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 42 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.798569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:2.0:1789120844.798579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:2349:x1876028901382784:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120844.798597:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120844.798606:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 42 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798622:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 42 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798650:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b068 expref: 42 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798692:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.798699:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798709:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798718:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.798751:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120844.798830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:2349:x1876028901382784:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 252us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.798839:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00010000:00010000:1.0:1789120844.798932:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.798941:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120844.798963:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789120844.799161:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b084 expref: 42 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.799179:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b084 expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.799188:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120844.799191:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120844.799193:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba600, rc 0) 00000100:00100000:1.0:1789120844.799244:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1b6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11780:x1876028901382656:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 4827us (6567us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789120844.799252:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 201 00000100:00100000:3.0:1789120844.803423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.803577:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383040 00000100:00100000:2.0:1789120844.803589:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383040 00000100:00100000:2.0:1789120844.803651:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 202 00000100:00100000:2.0:1789120844.803663:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+41:11780:x1876028901383040:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120844.803693:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.803696:0:5858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120844.803729:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5b4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b084 expref: 41 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.803752:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.803766:0:5858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120844.803796:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b08b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.803951:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.803968:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.803980:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120844.803992:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789120844.804132:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b08b expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.804173:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b08b expref: 42 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.804181:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120844.804184:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789120844.804186:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa4800, rc 0) 00000100:00100000:2.0:1789120844.804250:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:11780:x1876028901383040:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 590us (839us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789120844.804259:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 202 00000100:00100000:0.0:1789120844.811239:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.811379:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383168 00000100:00100000:2.0:1789120844.811392:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383168 00000100:00100000:2.0:1789120844.811460:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:2.0:1789120844.811472:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+42:11780:x1876028901383168:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120844.811502:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.811543:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b092 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.811614:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 43 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.811631:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 43 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.811651:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:2.0:1789120844.811655:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120844.811659:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5200, rc 0) 00000100:00100000:2.0:1789120844.811730:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:11780:x1876028901383168:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 260us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.811738:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 203 00000100:00100000:0.0:1789120844.817797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.817876:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383296 00000100:00100000:1.0:1789120844.817889:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383296 00000100:00100000:1.0:1789120844.818025:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:1.0:1789120844.818039:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+6:2350:x1876028901383296:12345-192.168.206.9@tcp:1:lfs.0 00010000:00010000:1.0:1789120844.818099:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.818131:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.818183:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789120844.818189:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120844.818195:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.818239:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.818266:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 6 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.818283:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922344960:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120844.818387:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120844.821486:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1876028922344960:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120844.821525:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120844.822358:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.822501:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383424 00000100:00100000:1.0:1789120844.822509:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383424 00002000:00100000:1.0:1789120844.822570:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ffdc1d6ad00 x1876028901383424/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:375/0 lens 504/0 e 0 to 0 dl 1789120855 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120844.822604:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdc1d6ad00 with x1876028901383424 ext(0->8) 00010000:00010000:1.0:1789120844.822615:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 7 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.822703:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 7 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120844.822712:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdc1d6ad00 00000100:00100000:1.0:1789120844.822751:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789120844.822762:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901383424:12345-192.168.206.9@tcp:4:lfs.0 00000100:00100000:1.0:1789120844.823564:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901383424:12345-192.168.206.9@tcp:4:lfs.0 Request processed in 801us (1210us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789120844.823573:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00002000:00100000:1.0:1789120844.823583:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ffdc1d6ad00 x1876028901383424/t4294967308(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:375/0 lens 504/448 e 0 to 0 dl 1789120855 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120844.823591:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdc1d6ad00 with x1876028901383424 ext(0->8) 00010000:00010000:1.0:1789120844.823597:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.823609:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120844.823616:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ffdc1d6ad00 00000100:00100000:3.0:1789120844.825705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.825972:0:12923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383552 00000100:00100000:1.0:1789120844.825993:0:12923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383552 00010000:00010000:1.0:1789120844.826038:0:12923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.826091:0:12923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:1.0:1789120844.826102:0:12923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901383552:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120844.826120:0:12923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789120844.826190:0:12923:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789120844.826194:0:12923:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789120844 00002000:00010000:1.0:1789120844.826197:0:12923:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789120844 00002000:00010000:1.0:1789120844.826199:0:12923:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789120844 00010000:00010000:1.0:1789120844.826207:0:12923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.826222:0:12923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.826252:0:12923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa5b31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b076 expref: 9 pid: 6705 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.826283:0:12923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120844.826636:0:12923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120844.826645:0:12923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.826657:0:12923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120844.826886:0:12923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120844.826968:0:12923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901383552:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 866us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120844.826978:0:12923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00010000:00010000:1.0:1789120844.827127:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827243:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827409:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827419:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827428:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827435:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120844.827440:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827451:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827520:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.827544:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f04824b/0x13cfa3d77faa5b77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.827707:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2350:x1876028901383296:12345-192.168.206.9@tcp:1:lfs.0 Request processed in 9669us (9932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.827718:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:3.0:1789120844.830870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.834162:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383808 00000100:00100000:2.0:1789120844.834184:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383808 00000100:00100000:3.0:1789120844.834333:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 56 00000100:00100000:3.0:1789120844.834348:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+43:11780:x1876028901383808:12345-192.168.206.9@tcp:35:lfs.0 00000004:00010000:3.0:1789120844.834429:0:5860:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b08b expref: 43 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120844.834832:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789120844.834881:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789120844.835637:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789120844.835706:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.835745:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 47 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.835756:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.835813:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 47 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.835832:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 47 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120844.835849:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922345088:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120844.835985:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120844.839670:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5860:1876028922345088:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120844.839707:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.840271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120844.840741:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901383936 00000100:00100000:3.0:1789120844.840750:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901383936 00010000:00010000:3.0:1789120844.840806:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 48 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120844.840918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:3.0:1789120844.840930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+48:2350:x1876028901383936:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120844.840975:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120844.840991:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 48 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841006:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 48 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b092 expref: 48 pid: 8217 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841053:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:3.0:1789120844.841060:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841435:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841445:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120844.841522:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120844.841593:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+47:2350:x1876028901383936:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 663us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120844.841602:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00010000:00010000:1.0:1789120844.841645:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.842525:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120844.844821:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789120844.845190:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789120844.845443:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d6a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922345216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120844.845531:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120844.845579:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120844.845620:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922345216 00000100:00100000:2.0:1789120844.845630:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922345216 00000100:00100000:2.0:1789120844.845733:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120844.845744:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922345216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789120844.845866:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922345216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.845874:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120844.846059:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d6a940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922345216:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1789120844.846497:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789120844.850170:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789120844.850286:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922345344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789120844.850375:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.850414:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120844.850935:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922345344 00000100:00100000:0.0:1789120844.850945:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922345344 00000100:00100000:0.0:1789120844.851013:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120844.851026:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5860:x1876028922345344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120844.851283:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5860:x1876028922345344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 259us (906us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789120844.851293:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789120844.851459:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5860:1876028922345344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789120844.851524:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789120844.851567:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851580:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851590:0:5860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851607:0:5860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.851612:0:5860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851621:0:5860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851651:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:1.0:1789120844.851654:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789120844.851660:0:5860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.851667:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5b7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120844.851865:0:5860:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789120844.851972:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789120844.851983:0:5860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312105838959ns, next at 313105836551ns, rc = 0 00000001:00080000:1.0:1789120844.851990:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789120844.852026:0:5860:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3600) 00010000:00010000:1.0:1789120844.852029:0:5860:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789120844.852036:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b08b expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.852173:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:11780:x1876028901383808:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 17828us (21315us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789120844.852182:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 56 00000020:00080000:1.0:1789120844.852187:0:5860:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789120844.857463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.857883:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901384064 00000100:00100000:2.0:1789120844.857896:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901384064 00000100:00100000:2.0:1789120844.857979:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 204 00000100:00100000:2.0:1789120844.857992:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+50:11780:x1876028901384064:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120844.858044:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.858074:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b099 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.858194:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b099 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.858212:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b099 expref: 51 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.858238:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.858242:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120844.858247:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb5fa5e00, rc 0) 00000100:00100000:2.0:1789120844.858351:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:11780:x1876028901384064:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 361us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.858360:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 204 00000100:00100000:0.0:1789120844.861866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.862579:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901384320 00000100:00100000:2.0:1789120844.862593:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901384320 00000100:00100000:2.0:1789120844.862762:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:2.0:1789120844.864011:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+51:11780:x1876028901384320:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120844.864271:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:11780:x1876028901384320:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 1498us (2418us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789120844.864280:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 57 00000100:00100000:0.0:1789120844.912561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.912684:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901384448 00000100:00100000:2.0:1789120844.912694:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901384448 00000100:00100000:2.0:1789120844.912955:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:2.0:1789120844.912966:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:11790:x1876028901384448:12345-192.168.206.9@tcp:34:lfs.0 00010000:00010000:2.0:1789120844.913056:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913074:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913085:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913100:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913108:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913114:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913247:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913255:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913262:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120844.913303:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913315:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913330:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913336:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913343:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.913347:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913354:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913365:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120844.913368:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.913372:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913379:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913392:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913397:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913402:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913406:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.913414:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913420:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913427:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120844.913430:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.913433:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913438:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913452:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913459:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913464:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913468:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.913471:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913477:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913484:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.913486:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.913497:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.913503:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120844.913565:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:11790:x1876028901384448:12345-192.168.206.9@tcp:34:lfs.0 Request processed in 599us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.913574:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 205 00000100:00100000:3.0:1789120844.942673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.942887:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901384704 00000100:00100000:2.0:1789120844.942897:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901384704 00000100:00100000:2.0:1789120844.943008:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 206 00000100:00100000:2.0:1789120844.943019:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+52:11793:x1876028901384704:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120844.943038:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120844.943060:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0a0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943134:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943280:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943293:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943310:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943317:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943341:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943481:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943490:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943498:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120844.943509:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789120844.943616:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943624:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943630:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943636:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.943639:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943647:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943658:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120844.943661:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.943671:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943678:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4000/0x13cfa3d77faa5ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943690:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943696:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943701:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943706:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120844.943709:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943714:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943721:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd84cf3000) 00010000:00010000:2.0:1789120844.943723:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120844.943726:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943792:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4800/0x13cfa3d77faa5baf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943835:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5200/0x13cfa3d77faa5ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943860:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 54 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120844.943868:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120844.943870:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120844.943872:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57e00, rc 0) 00000100:00100000:2.0:1789120844.943980:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:11793:x1876028901384704:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 962us (1320us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789120844.943988:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 206 00000100:00100000:0.0:1789120844.947642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120844.948008:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901384832 00000100:00100000:1.0:1789120844.948021:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901384832 00000100:00100000:1.0:1789120844.948106:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:1.0:1789120844.948119:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:11793:x1876028901384832:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789120844.951011:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951044:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951059:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951094:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951101:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951109:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951116:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120844.951122:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951970:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.951995:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120844.951999:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120844.952026:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120844.952034:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120844.952253:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:11793:x1876028901384832:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 4129us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.952266:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 207 00000100:00100000:0.0:1789120844.961986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120844.962197:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385088 00000100:00100000:2.0:1789120844.962211:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385088 00000100:00100000:2.0:1789120844.962285:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:2.0:1789120844.962298:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+54:11793:x1876028901385088:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120844.962682:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:11793:x1876028901385088:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 385us (708us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789120844.962691:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 58 00000100:00100000:3.0:1789120845.024623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.024858:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385344 00000100:00100000:1.0:1789120845.024871:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385344 00000100:00100000:1.0:1789120845.024971:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:1.0:1789120845.024983:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:11803:x1876028901385344:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:1.0:1789120845.025014:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.025019:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789120845.025054:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5c00/0x13cfa3d77faa5b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b07d expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025077:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120845.025084:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120845.025100:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0a7 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025299:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025316:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025325:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025384:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 55 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.025401:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 55 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.025417:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922345472:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120845.025547:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120845.032020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.032276:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5857:1876028922345472:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.032327:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.032693:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385472 00000100:00100000:2.0:1789120845.032702:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385472 00010000:00010000:2.0:1789120845.032750:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 56 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.032805:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:2.0:1789120845.032890:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+56:2349:x1876028901385472:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120845.032910:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120845.032918:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 56 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033050:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 56 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033077:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a0 expref: 56 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033096:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120845.033102:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033114:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033123:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.033239:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120845.033309:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:2349:x1876028901385472:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 494us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.033437:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00010000:00010000:2.0:1789120845.035690:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120845.036179:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.036196:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.036222:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789120845.036439:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 56 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.036611:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 55 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.036623:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.036627:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120845.036647:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120845.036731:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:11803:x1876028901385344:12345-192.168.206.9@tcp:101:bash.0 Request processed in 11750us (12121us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789120845.036780:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 208 00000100:00100000:0.0:1789120845.042630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.042757:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385728 00000100:00100000:2.0:1789120845.043620:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385728 00000100:00100000:2.0:1789120845.043801:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 209 00000100:00100000:2.0:1789120845.043867:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+55:11803:x1876028901385728:12345-192.168.206.9@tcp:36:bash.0 00010000:00010000:2.0:1789120845.044284:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.044428:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.044443:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120845.044604:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789120845.044628:0:8217:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007d9c3050 reply state 000000000513ca38 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.044638:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120845.045226:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:11803:x1876028901385728:12345-192.168.206.9@tcp:36:bash.0 Request processed in 1411us (2604us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789120845.045236:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 209 00000020:00080000:2.0:1789120845.045243:0:8217:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789120845.049855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.050028:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385856 00000100:00100000:2.0:1789120845.050040:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385856 00000100:00100000:2.0:1789120845.050117:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:2.0:1789120845.050127:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:11803:x1876028901385856:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120845.050186:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120845.050213:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0ae expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050310:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050330:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050356:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050365:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050383:0:5858:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050409:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.050424:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.050440:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5532940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922345600:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120845.050534:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd855e2600 going to sleep for 11 seconds 00010000:00010000:1.0:1789120845.051429:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051440:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051448:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051532:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.051537:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051547:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051564:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.051567:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.051570:0:3303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051581:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.051587:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa5be0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.054118:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5532940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922345600:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.054199:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.055277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.055365:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901385984 00000100:00100000:2.0:1789120845.055373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901385984 00010000:00010000:2.0:1789120845.055417:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.055469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:2.0:1789120845.055481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:2350:x1876028901385984:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120845.055499:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120845.055507:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055539:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055567:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5bd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0a7 expref: 59 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055586:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120845.055591:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055601:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055608:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.055636:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120845.055702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:2350:x1876028901385984:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 223us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.055711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00010000:00010000:1.0:1789120845.056657:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.056671:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.056736:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789120845.056742:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120845.056764:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.056911:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 58 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.056942:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 57 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.056952:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.056955:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120845.056959:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57a00, rc 0) 00000100:00100000:1.0:1789120845.057018:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:11803:x1876028901385856:12345-192.168.206.9@tcp:101:bash.0 Request processed in 6892us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.057027:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 210 00000100:00100000:0.0:1789120845.062043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.062248:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901386240 00000100:00100000:2.0:1789120845.062260:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901386240 00000100:00100000:2.0:1789120845.062410:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:2.0:1789120845.062422:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+57:11803:x1876028901386240:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789120845.064621:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:11803:x1876028901386240:12345-192.168.206.9@tcp:35:bash.0 Request processed in 2190us (2891us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789120845.064635:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 59 00000100:00100000:2.0:1789120845.157266:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.157492:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901386368 00000100:00100000:1.0:1789120845.157504:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901386368 00000100:00100000:1.0:1789120845.157580:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:1.0:1789120845.157591:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5531680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+58:11809:x1876028901386368:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120845.157637:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.157673:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0b5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.157756:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.157784:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.157800:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.157873:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789120845.157878:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120845.157964:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.157995:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0b5 expref: 60 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.158017:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0b5 expref: 59 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.158028:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120845.158032:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120845.158036:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120845.158254:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5531680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901386368:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 664us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.158263:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 211 00000100:00100000:3.0:1789120845.161257:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.161345:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901386496 00000100:00100000:1.0:1789120845.161358:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901386496 00000100:00100000:1.0:1789120845.161430:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:1.0:1789120845.161446:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901386496:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120845.161472:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.161496:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0bc expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161567:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161583:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161596:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161612:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161619:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161625:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161748:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161757:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161796:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.161836:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789120845.161841:0:5857:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120845.161862:0:5857:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161880:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161889:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.161896:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162443:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162450:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.162455:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162613:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162629:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120845.162633:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.162638:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162659:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162677:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162684:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162691:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162696:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.162700:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162706:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162714:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120845.162717:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.162721:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.162893:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.163039:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.163055:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 60 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.163071:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.163074:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120845.163077:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bba00, rc 0) 00000100:00100000:1.0:1789120845.163339:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11809:x1876028901386496:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1894us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.163348:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 212 00000100:00100000:0.0:1789120845.166843:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.167290:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901386752 00000100:00100000:1.0:1789120845.167303:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901386752 00000100:00100000:1.0:1789120845.167379:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:1.0:1789120845.167391:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11809:x1876028901386752:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120845.167417:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.167443:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0c3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167587:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167605:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167616:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167625:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167696:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.167830:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.167849:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922345728:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.168508:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.168521:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.168532:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922345856:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120845.168562:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafeee840 going to sleep for 11 seconds 00000100:00100000:2.0:1789120845.171121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120845.171682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901386880 00000100:00100000:0.0:1789120845.171693:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901386880 00010000:00010000:0.0:1789120845.171752:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 62 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.171816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:0.0:1789120845.171828:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:2349:x1876028901386880:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120845.171847:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120845.171854:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 62 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.171869:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 62 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.171906:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120845.171912:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.171922:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.172070:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120845.172138:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:2349:x1876028901386880:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 312us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120845.172182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00010000:00010000:1.0:1789120845.175915:0:5859:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.9@tcp) returned -22 from blocking AST (req@00000000c4adf68b x1876028922345728) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.175955:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0bc expref: 61 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.175975:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922345728:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120845.179041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.179230:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922345856:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.179265:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.179272:0:5859:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.179308:0:5859:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.179329:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120845.179776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387008 00000100:00100000:3.0:1789120845.179785:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387008 00010000:00010000:3.0:1789120845.179836:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120845.180070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:3.0:1789120845.180083:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:2350:x1876028901387008:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120845.180100:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120845.180108:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180122:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180181:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ae expref: 61 pid: 5858 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180198:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:3.0:1789120845.180203:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180212:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180220:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.180242:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120845.180304:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:2350:x1876028901387008:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 224us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120845.180313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00010000:00010000:1.0:1789120845.180381:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.180389:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.180410:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789120845.180574:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 61 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.180589:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 60 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.180597:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.180600:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120845.180603:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120845.180627:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11809:x1876028901386752:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 13240us (13800us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789120845.180634:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 213 00000100:00100000:0.0:1789120845.184611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.184722:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387264 00000100:00100000:2.0:1789120845.184803:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387264 00000100:00100000:2.0:1789120845.185015:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789120845.185029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11809:x1876028901387264:12345-192.168.206.9@tcp:103:lfs.0 00010000:00010000:2.0:1789120845.185048:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120845.185079:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa5e00/0x13cfa3d77faa5b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b099 expref: 60 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.185102:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120845.185107:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120845.185483:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901387264:12345-192.168.206.9@tcp:103:lfs.0 Request processed in 456us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.185492:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:3.0:1789120845.187574:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.187693:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387392 00000100:00100000:1.0:1789120845.187703:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387392 00000100:00100000:1.0:1789120845.187783:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:1.0:1789120845.187795:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901387392:12345-192.168.206.9@tcp:58:lfs.0 00010000:00010000:1.0:1789120845.188100:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.188120:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.188134:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120845.188389:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789120845.188495:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5905a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901387392:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 701us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.188504:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 214 00000100:00100000:3.0:1789120845.190906:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.191086:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387520 00000100:00100000:1.0:1789120845.191098:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387520 00000100:00100000:1.0:1789120845.191192:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 215 00000100:00100000:1.0:1789120845.191203:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+59:11809:x1876028901387520:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120845.191227:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.191252:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0ca expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191316:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191337:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191360:0:8217:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191396:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191412:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.191415:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120845.191419:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.191427:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb800, rc 0) 00000100:00100000:1.0:1789120845.191497:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11809:x1876028901387520:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 293us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.191506:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 215 00000001:00080000:3.0:1789120845.607174:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789120845.607405:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:0.0:1789120845.674729:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120845.674742:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120845.675064:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789120845.675072:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120845.675245:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1d68000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922345984:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120845.677892:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120845.688963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.689105:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387648 00000100:00100000:1.0:1789120845.689117:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387648 00000100:00100000:1.0:1789120845.689225:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:1.0:1789120845.689236:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901387648:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120845.689277:0:5858:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120845.689400:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901387648:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 166us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.689409:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 216 00000100:00100000:0.0:1789120845.689715:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1d68000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922345984:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789120845.697667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.697822:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901387776 00000100:00100000:2.0:1789120845.697834:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901387776 00000100:00100000:2.0:1789120845.697922:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:2.0:1789120845.697933:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11810:x1876028901387776:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.698037:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698057:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698071:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698113:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698121:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698128:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698197:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698206:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698213:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120845.698263:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789120845.698269:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120845.698284:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698296:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698304:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698312:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698333:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120845.698338:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698346:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698361:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:2.0:1789120845.698364:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120845.698370:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698377:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698392:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698398:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698404:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698410:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120845.698413:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698419:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698436:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ffd84cf3500) 00010000:00010000:2.0:1789120845.698438:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120845.698442:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698459:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698477:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698484:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698489:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698493:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120845.698496:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698502:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698510:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120845.698513:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120845.698516:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.698522:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.702266:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11810:x1876028901387776:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 4320us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.702889:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 217 00000100:00100000:3.0:1789120845.714544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.716058:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901388032 00000100:00100000:1.0:1789120845.716075:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901388032 00000100:00100000:1.0:1789120845.716261:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:1.0:1789120845.716273:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+60:11810:x1876028901388032:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.716299:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.716343:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0d1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716475:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716492:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716505:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.716518:0:5858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789120845.716647:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716655:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716663:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716670:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.716675:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716684:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716697:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.716700:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120845.716706:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716723:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716783:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c57 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0d1 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716795:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:1.0:1789120845.716798:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120845.716802:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0d1 expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.716822:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb000, rc 0) 00000100:00100000:1.0:1789120845.717853:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388032:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1452us (4159us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789120845.717867:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 218 00000100:00100000:2.0:1789120845.728295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.730447:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901388160 00000100:00100000:1.0:1789120845.730465:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901388160 00000100:00100000:1.0:1789120845.730573:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 219 00000100:00100000:1.0:1789120845.730586:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388160:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120845.730634:0:8217:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120845.730814:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388160:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 229us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.730823:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 219 00000100:00100000:3.0:1789120845.736199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.736306:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901388416 00000100:00100000:2.0:1789120845.736325:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901388416 00000100:00100000:2.0:1789120845.736400:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:2.0:1789120845.736412:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388416:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.736442:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120845.736445:0:5857:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120845.736484:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0b5 expref: 61 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.736507:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:2.0:1789120845.736512:0:5857:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120845.736529:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0d8 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120845.737040:0:5857:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789120845.737326:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.737343:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.737355:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.737428:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5c6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0d8 expref: 63 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.737448:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0d8 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.737457:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd84cf3500) 00010000:00010000:2.0:1789120845.737460:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120845.737463:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57400, rc 0) 00000100:00100000:2.0:1789120845.737718:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:11810:x1876028901388416:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1305us (1575us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789120845.737727:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 220 00000100:00100000:3.0:1789120845.739834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.739924:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901388672 00000100:00100000:1.0:1789120845.739936:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901388672 00000100:00100000:1.0:1789120845.740011:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 221 00000100:00100000:1.0:1789120845.740036:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:11810:x1876028901388672:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.740102:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120845.740132:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0d8 expref: 62 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740189:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd84cf3500) 00010000:00010000:1.0:1789120845.740202:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120845.740227:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740242:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740252:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740424:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740448:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740460:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740537:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740545:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740569:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740575:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.740579:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740587:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740598:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120845.740602:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.740606:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740612:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa5c81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740625:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740631:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740637:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740642:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.740645:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740658:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740666:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x803104c0 (ffff9ffd82a3f100) 00010000:00010000:1.0:1789120845.740668:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.740671:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.740676:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5c88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x803104c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.740785:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388672:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 747us (958us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120845.740794:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 221 00000100:00100000:0.0:1789120845.744343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.749219:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901388800 00000100:00100000:1.0:1789120845.749240:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901388800 00000100:00100000:1.0:1789120845.749333:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:1.0:1789120845.749345:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+61:11810:x1876028901388800:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.749372:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.749405:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0df expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749449:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749465:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749480:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749630:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 63 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749650:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 62 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.749659:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120845.749662:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120845.749667:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba600, rc 0) 00000100:00100000:1.0:1789120845.749754:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:11810:x1876028901388800:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 411us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.749762:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 222 00000100:00100000:0.0:1789120845.753236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.753592:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389056 00000100:00100000:2.0:1789120845.753604:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389056 00000100:00100000:2.0:1789120845.753680:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 223 00000100:00100000:2.0:1789120845.753691:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+62:11810:x1876028901389056:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.753829:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.755790:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.755817:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120845.756132:0:5859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789120845.756164:0:5859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313010019484ns, next at 314009996933ns, rc = 0 00000004:00010000:2.0:1789120845.756293:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b04df8b1 reply state 0000000091c6c7e4 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.756303:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120845.756436:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+64:11810:x1876028901389056:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 2741us (3207us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789120845.756447:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 223 00010000:00010000:2.0:1789120845.759860:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759880:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759888:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759895:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120845.759901:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759910:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759929:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120845.759933:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789120845.759938:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.759945:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5c9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.760241:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.760373:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389184 00000100:00100000:2.0:1789120845.760400:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389184 00000100:00100000:2.0:1789120845.760507:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:2.0:1789120845.760518:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+63:11810:x1876028901389184:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.760546:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120845.760567:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0e6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.760634:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.760648:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 64 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.760669:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120845.760672:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120845.760675:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56400, rc 0) 00000100:00100000:2.0:1789120845.760744:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+64:11810:x1876028901389184:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 227us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.760752:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 224 00000100:00100000:3.0:1789120845.763340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.763429:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389312 00000100:00100000:1.0:1789120845.763444:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389312 00000100:00100000:1.0:1789120845.763529:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789120845.763541:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2350:x1876028901389312:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789120845.763935:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f10b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2350:x1876028901389312:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 394us (602us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789120845.763944:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:0.0:1789120845.770260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.770418:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389568 00000100:00100000:1.0:1789120845.770427:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389568 00000100:00100000:1.0:1789120845.770480:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:1.0:1789120845.770490:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+64:11810:x1876028901389568:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789120845.770753:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+65:11810:x1876028901389568:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 265us (501us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789120845.770787:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 60 00000100:00100000:0.0:1789120845.773735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.773857:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389824 00000100:00100000:1.0:1789120845.773865:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389824 00000100:00100000:1.0:1789120845.774093:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 225 00000100:00100000:1.0:1789120845.774104:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+65:11810:x1876028901389824:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120845.774238:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+65:11810:x1876028901389824:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 136us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.774246:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 225 00000100:00100000:3.0:1789120845.777290:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.777488:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901389952 00000100:00100000:1.0:1789120845.777496:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901389952 00000100:00100000:1.0:1789120845.777550:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:1.0:1789120845.777559:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+65:11810:x1876028901389952:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.777578:0:5858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.777597:0:5858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0ed expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777683:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777696:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777707:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120845.777742:0:5858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120845.777761:0:5858:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777808:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ed expref: 67 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777949:0:5858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ed expref: 66 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.777958:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120845.777961:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789120845.777965:0:5858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bba00, rc 0) 00000100:00100000:1.0:1789120845.778075:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+66:11810:x1876028901389952:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 516us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.778083:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 226 00000100:00100000:0.0:1789120845.782002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.782121:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390080 00000100:00100000:2.0:1789120845.782129:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390080 00000100:00100000:2.0:1789120845.782195:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:2.0:1789120845.782205:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+10:2352:x1876028901390080:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.782223:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120845.782243:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0f4 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120845.782289:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d14d, blocks: 0x1 00010000:00010000:2.0:1789120845.782308:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789120845.782312:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120845.782321:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.782339:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.782353:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56e00, rc 0) 00000100:00100000:2.0:1789120845.782409:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1d6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2352:x1876028901390080:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 205us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.782416:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:0.0:1789120845.797027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.799644:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390336 00000100:00100000:2.0:1789120845.799656:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390336 00000100:00100000:2.0:1789120845.799727:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 227 00000100:00100000:2.0:1789120845.799738:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+66:11810:x1876028901390336:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789120845.799855:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+66:11810:x1876028901390336:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 119us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.799863:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 227 00000100:00100000:3.0:1789120845.802670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.804030:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390464 00000100:00100000:1.0:1789120845.804040:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390464 00000100:00100000:1.0:1789120845.804095:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:1.0:1789120845.804104:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:11810:x1876028901390464:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.804120:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120845.804137:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b0fb expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.804191:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.804201:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120845.804205:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120845.804210:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.804260:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.804274:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.804289:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922346112:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120845.804572:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5693b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120845.809697:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1876028922346112:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120845.809735:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.809757:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba400, rc 0) 00000100:00100000:3.0:1789120845.809985:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:11810:x1876028901390464:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 5879us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120845.809994:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:2.0:1789120845.817691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120845.817801:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390592 00000100:00100000:0.0:1789120845.817809:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390592 00010000:00010000:0.0:1789120845.817967:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.818010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:0.0:1789120845.818020:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:2350:x1876028901390592:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120845.818034:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120845.818055:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.818085:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.818107:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3e24146/0x13cfa3d77faa5cb9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0f4 expref: 12 pid: 6706 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.818398:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120845.818403:0:5843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120845.818411:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.818421:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.818548:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.818566:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922346240:192.168.206.9@tcp:105: 00000100:00100000:0.0:1789120845.818682:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120845.824217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120845.824633:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5843:1876028922346240:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789120845.824652:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120845.824703:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2350:x1876028901390592:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 6685us (7021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120845.824714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:1.0:1789120845.826132:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390720 00000100:00100000:1.0:1789120845.826161:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390720 00002000:00100000:1.0:1789120845.826210:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ffdb598d680 x1876028901390720/t0(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:376/0 lens 504/0 e 0 to 0 dl 1789120856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120845.826221:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb598d680 with x1876028901390720 ext(0->12) 00002000:00010000:1.0:1789120845.826226:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb598d680 00000100:00100000:1.0:1789120845.826253:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120845.826477:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+11:2349:x1876028901390720:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789120845.826910:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:2349:x1876028901390720:12345-192.168.206.9@tcp:4:lhsmtool_posix.0 Request processed in 436us (2700us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789120845.827465:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00002000:00100000:1.0:1789120845.827474:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ffdb598d680 x1876028901390720/t4294967320(0) o4->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:376/0 lens 504/448 e 0 to 0 dl 1789120856 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120845.827483:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdb598d680 with x1876028901390720 ext(0->12) 00002000:00010000:1.0:1789120845.827487:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdb598d680 00000100:00100000:0.0:1789120845.830219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.830423:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390848 00000100:00100000:2.0:1789120845.830431:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390848 00000100:00100000:2.0:1789120845.830526:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 228 00000100:00100000:2.0:1789120845.830536:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+66:11810:x1876028901390848:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789120845.899009:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+66:11810:x1876028901390848:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 68460us (68782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120845.899024:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 228 00000001:00080000:0.0:1789120845.899262:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000001:00080000:0.0:1789120845.899279:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789120845.899298:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789120845.899698:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffdafeee780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789120845.899703:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd90b08e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdafeee300 00000020:00080000:0.0:1789120845.899707:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd90b08900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb9654000 00000004:00080000:0.0:1789120845.899735:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1789120845.899772:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789120845.899822:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffdbfbdfd80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789120845.899826:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd82bbe400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdbfbdf0c0 00000020:00080000:0.0:1789120845.899829:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd82bbed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdb998b800 00000100:00100000:2.0:1789120845.899926:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120845.899946:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5530f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922346368:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789120845.900032:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789120845.900241:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789120845.900538:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922346624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789120845.900699:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922346496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789120845.904844:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120845.905043:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922346368 00000100:00100000:0.0:1789120845.905054:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922346368 00000100:00100000:0.0:1789120845.905121:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120845.905132:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922346368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789120845.905185:0:8216:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1789120845.905227:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3d14c, atime: 0x6aa3d14c, ctime: 0x6aa3d14c, blocks: 0xb 00010000:00010000:0.0:1789120845.905236:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.905256:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1789120845.905262:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120845.905271:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.905289:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.905318:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.905327:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.905350:0:8216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789120845.905565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.908469:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120845.908630:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922346368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3497us (3792us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789120845.908645:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120845.908683:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901390976 00000100:00100000:0.0:1789120845.908691:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901390976 00000100:00100000:0.0:1789120845.908724:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922346624 00000100:00100000:0.0:1789120845.908727:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922346624 00000100:00100000:0.0:1789120845.908773:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:0.0:1789120845.908784:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5532d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:2350:x1876028901390976:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789120845.908794:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120845.908856:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120845.908867:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.908882:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120845.908888:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.908900:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.908933:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.908942:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.908968:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120845.908971:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120845.908974:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120845.908988:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922346496 00000100:00100000:0.0:1789120845.908992:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922346496 00000100:00100000:0.0:1789120845.909016:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789120845.909026:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1876028922346624:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789120845.909828:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789120845.909974:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789120845.909979:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789120845 00002000:00010000:0.0:1789120845.909982:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789120845.909985:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789120845 -> 1789120845 00002000:00010000:0.0:1789120845.909987:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789120845.910042:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3318:x1876028922346624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1018us (1581us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789120845.910050:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789120845.910072:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120845.910080:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1876028922346496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789120845.910100:0:6705:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1789120845.910128:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.910161:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.910172:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789120845.910177:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120845.910182:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.910218:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.910238:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 13 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.910253:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922346752:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120845.910332:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb55030c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789120845.910370:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffd955a7480/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789120845.910376:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922346624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789120845.910510:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789120845.910517:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1789120845.910541:0:3319:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffdb5530f00 x1876028922346368/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789120861 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789120845.910551:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb5530f00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789120845.910562:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5530f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922346368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789120845.915631:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922346752:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120845.915631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00010000:00010000:1.0:1789120845.915669:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.915674:0:12923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901391104 00000100:00100000:0.0:1789120845.915683:0:12923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901391104 00010000:00010000:0.0:1789120845.915727:0:12923:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 14 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.915788:0:12923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:0.0:1789120845.915799:0:12923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+14:2349:x1876028901391104:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120845.915815:0:12923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120845.915822:0:12923:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 14 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.915836:0:12923:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 14 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.915863:0:12923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab666187/0x13cfa3d77faa5a82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b053 expref: 14 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.915894:0:12923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120845.915900:0:12923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120845.915906:0:12923:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.915917:0:12923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.915974:0:12923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120845.916034:0:12923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+13:2349:x1876028901391104:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 237us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120845.916043:0:12923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00010000:00010000:1.0:1789120845.916114:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.916125:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.916137:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.916169:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.916190:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789120845.916742:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1876028922346496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6661us (7948us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789120845.916753:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1789120845.916808:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffd955a52c0/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789120845.916816:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922346496:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789120845.916949:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120845.916957:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.916967:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120845.916972:0:12067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.916983:0:12067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.916997:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.917004:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fedc64b/0x13cfa3d77faa5cce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.917026:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120845.917028:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120845.917029:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120845.940030:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5532d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+12:2350:x1876028901390976:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 31235us (34455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120845.940063:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000001:00080000:1.0:1789120845.942244:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1789120845.942270:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1789120845.944507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.944711:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901391360 00000100:00100000:2.0:1789120845.944733:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901391360 00000100:00100000:2.0:1789120845.944821:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 229 00000100:00100000:2.0:1789120845.944833:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11810:x1876028901391360:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.944906:0:5859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120845.944939:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa5cb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ed expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.944960:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120845.944966:0:5859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120845.945224:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.945241:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.945253:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120845.945539:0:5859:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000529b4a2b reply state 000000004956e054 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.945634:0:5859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120845.945742:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:11810:x1876028901391360:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 910us (1247us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789120845.945751:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 229 00010000:00010000:1.0:1789120845.948127:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948199:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948207:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948214:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.948219:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948228:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948247:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120845.948249:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.948254:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.948261:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa5cd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.950200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120845.950336:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901391488 00000100:00100000:1.0:1789120845.950347:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901391488 00000100:00100000:1.0:1789120845.950405:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:1.0:1789120845.950415:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901391488:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789120845.950805:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789120845.950810:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789120845 -> 1789120844 00002000:00010000:1.0:1789120845.950812:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789120844 00002000:00010000:1.0:1789120845.950815:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789120845 -> 1789120844 00002000:00010000:1.0:1789120845.950830:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789120845.950897:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2352:x1876028901391488:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 483us (708us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789120845.950906:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:1.0:1789120845.955837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.955937:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901391744 00000100:00100000:2.0:1789120845.955952:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901391744 00000100:00100000:2.0:1789120845.956025:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:2.0:1789120845.956035:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:11810:x1876028901391744:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789120845.956126:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.956175:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.956186:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.956226:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 20 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.956241:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 20 pid: 5858 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.956257:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5531e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922346880:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120845.956370:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120845.958784:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5531e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5858:1876028922346880:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120845.958838:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.959578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120845.959700:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901391872 00000100:00100000:3.0:1789120845.959708:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901391872 00010000:00010000:3.0:1789120845.959750:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 21 pid: 5858 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120845.959807:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789120845.959817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:2350:x1876028901391872:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120845.959834:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120845.959841:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 21 pid: 5858 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959855:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 21 pid: 5858 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959881:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba600/0x13cfa3d77faa5c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0df expref: 21 pid: 5858 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959899:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120845.959905:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959916:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959923:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.959967:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120845.960032:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:2350:x1876028901391872:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 216us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120845.960040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00010000:00010000:2.0:1789120845.960649:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960660:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960691:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960699:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960707:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960712:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120845.960717:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960725:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960736:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120845.960739:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789120845.960743:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.960750:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa5cdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.960843:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11810:x1876028901391744:12345-192.168.206.9@tcp:55:lhsmtool_posix.0 Request processed in 4808us (5017us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789120845.960852:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 230 00000100:00100000:1.0:1789120845.963107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120845.963281:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392000 00000100:00100000:0.0:1789120845.963292:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392000 00000100:00100000:0.0:1789120845.963361:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:0.0:1789120845.963371:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2349:x1876028901392000:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789120845.963425:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.963452:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.963462:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120845.963466:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120845.963471:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.963509:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120845.963524:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 8 pid: 6707 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.963540:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922347008:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120845.963754:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb5503f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120845.967017:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.967100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392128 00000100:00100000:2.0:1789120845.967110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392128 00010000:00010000:2.0:1789120845.967172:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 9 pid: 6707 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120845.967215:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:2.0:1789120845.967225:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901392128:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120845.967241:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120845.967268:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 9 pid: 6707 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.967282:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 9 pid: 6707 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.967321:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120845.967326:0:5844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120845.967332:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.967344:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120845.967388:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120845.967445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+9:2349:x1876028901392128:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 221us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.967454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00010000:00010000:1.0:1789120845.967869:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4a468f/0x13cfa3d77faa5cc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0fb expref: 8 pid: 6707 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.968005:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1876028922347008:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.968031:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968043:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968050:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968227:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968237:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968259:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968268:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4b600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120845.968278:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968289:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968304:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.968416:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6a1801e/0x13cfa3d77faa5ce3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.968480:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901392000:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 5109us (5382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120845.968489:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 70 00000100:00100000:1.0:1789120845.970975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.972481:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392384 00000100:00100000:2.0:1789120845.972749:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392384 00000100:00100000:1.0:1789120845.973210:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 231 00000100:00100000:1.0:1789120845.973224:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11810:x1876028901392384:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789120845.973380:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.973423:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.973959:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.974319:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.974334:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.974343:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.974387:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 20 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.974404:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 20 pid: 5857 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.974420:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922347136:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120845.974551:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120845.977443:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922347136:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120845.977481:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120845.977748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120845.977839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392512 00000100:00100000:3.0:1789120845.977847:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392512 00010000:00010000:3.0:1789120845.977942:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 21 pid: 5857 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120845.978012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:3.0:1789120845.978022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:2350:x1876028901392512:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120845.978039:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120845.978047:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 21 pid: 5857 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978060:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 21 pid: 5857 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa5ca4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0e6 expref: 21 pid: 5857 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978104:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:3.0:1789120845.978110:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978120:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978176:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120845.978201:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120845.978252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:2350:x1876028901392512:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 231us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120845.978260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 94 00010000:00010000:1.0:1789120845.978392:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.978408:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789120845.978621:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789120845.978796:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789120845.978841:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789120845.980355:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922347264:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789120845.980434:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120845.980595:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120845.980987:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922347264 00000100:00100000:2.0:1789120845.980996:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922347264 00000100:00100000:2.0:1789120845.981191:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120845.981205:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8217:x1876028922347264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789120845.981403:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8217:x1876028922347264:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.981411:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789120845.981429:0:8217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1789120845.981436:0:8217:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1789120845.981463:0:8217:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ffd955a7480 x1876028922346624/t4294967321(4294967321) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789120861 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120845.981477:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922347264:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789120845.982138:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789120845.982310:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922347392:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789120845.982355:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120845.982426:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120845.983373:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922347392 00000100:00100000:0.0:1789120845.983383:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922347392 00000100:00100000:0.0:1789120845.983448:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120845.983459:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8217:x1876028922347392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789120845.984561:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8217:x1876028922347392:12345-0@lo:1000:mdt00_003.0 Request processed in 1032us (2134us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789120845.984624:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789120845.985059:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1876028922347392:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789120845.985937:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.985950:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.985958:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.985988:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.985993:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986001:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986020:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:1.0:1789120845.986024:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120845.986029:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986035:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cf1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986221:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986229:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986235:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986240:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.986244:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986250:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986361:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.986364:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120845.986373:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986384:0:8217:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986394:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.986441:0:8217:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.986458:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd955a6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922347520:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789120845.986903:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120845.990020:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120845.991382:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392640 00000100:00100000:2.0:1789120845.991396:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392640 00000100:00100000:2.0:1789120845.991476:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:2.0:1789120845.991487:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11809:x1876028901392640:12345-192.168.206.9@tcp:49:lfs.0 00000100:00100000:2.0:1789120845.991775:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11809:x1876028901392640:12345-192.168.206.9@tcp:49:lfs.0 Request processed in 281us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120845.991784:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 61 00000100:00100000:1.0:1789120845.993329:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd955a6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1876028922347520:192.168.206.9@tcp:105: 00010000:00010000:1.0:1789120845.993371:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993384:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa5c34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993425:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993441:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993476:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993488:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993559:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993567:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993573:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.993578:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993586:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993600:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.993604:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120845.993608:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993614:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba400/0x13cfa3d77faa5cf8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993624:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993631:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993643:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993707:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120845.993710:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993717:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993726:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120845.993728:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120845.993731:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120845.993737:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb400/0x13cfa3d77faa5cea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120845.994369:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:11810:x1876028901392384:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 21143us (23400us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789120845.994382:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 231 00000020:00080000:1.0:1789120845.994390:0:8217:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789120845.994741:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120845.994747:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120845.995657:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789120845.995668:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789120845.996079:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120845.997175:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901392896 00000100:00100000:0.0:1789120845.997190:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901392896 00000100:00100000:3.0:1789120845.997481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120845.997658:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 232 00000100:00100000:0.0:1789120845.997676:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+23:11809:x1876028901392896:12345-192.168.206.9@tcp:58:lfs.0 00000100:00100000:1.0:1789120845.998041:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901393152 00000100:00100000:1.0:1789120845.998047:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901393152 00000100:00100000:1.0:1789120845.998083:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 62 00000100:00100000:1.0:1789120845.998092:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+24:11810:x1876028901393152:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1789120845.999127:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789120845.999493:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11809:x1876028901392896:12345-192.168.206.9@tcp:58:lfs.0 Request processed in 1822us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120845.999504:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 232 00000004:00080000:1.0:1789120846.001243:0:5860:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789120846.001899:0:5860:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789120846.001990:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002011:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002025:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002035:0:5860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002042:0:5860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002049:0:5860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.002075:0:5860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120846.003679:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120846.003693:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.003705:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbe00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120846.003709:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.003735:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.003754:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ffd82a3f600) 00010000:00010000:2.0:1789120846.003757:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120846.003773:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.003779:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbe00/0x13cfa3d77faa5cff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.003807:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120846.003809:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120846.003811:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120846.005292:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11810:x1876028901393152:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 7188us (7802us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789120846.005309:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 62 00000020:00080000:1.0:1789120846.005327:0:5860:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789120846.042086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120846.043729:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901393280 00000100:00100000:2.0:1789120846.043748:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901393280 00000100:00100000:2.0:1789120846.043931:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 233 00000100:00100000:2.0:1789120846.043943:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+25:11812:x1876028901393280:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120846.043974:0:5859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120846.043999:0:5859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56000/0x13cfa3d77faa5d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b102 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044079:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044097:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044110:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044196:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044206:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044213:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044549:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044561:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 26 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044582:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044624:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 26 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.044640:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 26 pid: 5859 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120846.044656:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5531e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922347648:192.168.206.9@tcp:104: 00000100:00100000:2.0:1789120846.044784:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00080000:0.0:1789120846.046263:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120846.056936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120846.057203:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901393536 00000100:00100000:3.0:1789120846.057215:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901393536 00000100:00100000:3.0:1789120846.057284:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:3.0:1789120846.057296:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:10708:x1876028901393536:12345-192.168.206.9@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789120846.057589:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:10708:x1876028901393536:12345-192.168.206.9@tcp:35:ldlm_bl.0 Request processed in 295us (665us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789120846.057599:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 63 00000100:00100000:0.0:1789120846.059088:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5532d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922347776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120846.059185:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120846.059256:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120846.059519:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5531e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5859:1876028922347648:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120846.059552:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120846.060014:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922347776 00000100:00100000:2.0:1789120846.060022:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922347776 00000100:00100000:2.0:1789120846.060092:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789120846.060103:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922347776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120846.060129:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789120846.060197:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922347776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120846.060206:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120846.060532:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5532d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922347776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120846.064135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120846.065724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901393664 00000100:00100000:2.0:1789120846.065741:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901393664 00010000:00010000:2.0:1789120846.065809:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 28 pid: 5859 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120846.065848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:2.0:1789120846.065859:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:2350:x1876028901393664:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120846.065875:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120846.065883:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 28 pid: 5859 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.065898:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 28 pid: 5859 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.065923:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba000/0x13cfa3d77faa5c26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0c3 expref: 28 pid: 5859 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.065943:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120846.065949:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.065961:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.065986:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120846.066018:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120846.066098:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f13840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+27:2350:x1876028901393664:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 240us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120846.066107:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00010000:00010000:1.0:1789120846.066579:0:5859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066590:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120846.066654:0:5859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789120846.066659:0:5859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120846.066682:0:5859:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066696:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066706:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066713:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066720:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066726:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120846.066732:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066741:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066753:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120846.066756:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120846.066760:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066777:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57000/0x13cfa3d77faa5d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066802:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066809:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066815:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066821:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120846.066824:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066831:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066838:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ffd84cf3a00) 00010000:00010000:1.0:1789120846.066840:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120846.066843:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066849:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57400/0x13cfa3d77faa5d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066891:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56000/0x13cfa3d77faa5d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b102 expref: 27 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066907:0:5859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b102 expref: 26 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120846.066925:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120846.066928:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120846.066930:0:5859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57a00, rc 0) 00000100:00100000:1.0:1789120846.066974:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11812:x1876028901393280:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 23034us (24902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120846.066983:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 233 00000040:00080000:2.0:1789120846.961756:0:12964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120846.961779:0:12964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120846.962003:0:12964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789120846.962010:0:12964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789120847.023468:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120847.023480:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120847.023672:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789120847.023680:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120847.023856:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922347904:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789120847.024294:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120847.032870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120847.033005:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f13480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12085:1876028922347904:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120847.033539:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901393792 00000100:00100000:2.0:1789120847.033548:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901393792 00000100:00100000:2.0:1789120847.033618:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 234 00000100:00100000:2.0:1789120847.033629:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11825:x1876028901393792:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120847.033681:0:5857:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120847.033815:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11825:x1876028901393792:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 186us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120847.033824:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 234 00000100:00100000:1.0:1789120847.050386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120847.050681:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394048 00000100:00100000:2.0:1789120847.050692:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394048 00000100:00100000:2.0:1789120847.050772:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 235 00000100:00100000:2.0:1789120847.050784:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+26:11825:x1876028901394048:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120847.050811:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120847.050838:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b109 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.050984:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa5d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.051002:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa5d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.051017:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa5d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120847.051029:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789120847.051224:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b109 expref: 29 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.051244:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa5d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b109 expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.051253:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120847.051257:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120847.051261:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57800, rc 0) 00000100:00100000:2.0:1789120847.052417:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11825:x1876028901394048:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 1626us (2036us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789120847.052430:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 235 00000100:00100000:3.0:1789120847.065623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120847.065685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120847.065749:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394304 00000100:00100000:2.0:1789120847.065773:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394304 00000100:00100000:2.0:1789120847.065845:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 236 00000100:00100000:2.0:1789120847.065855:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11825:x1876028901394304:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789120847.065968:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066002:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066014:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066270:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066279:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066286:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066292:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120847.066297:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066306:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066320:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:2.0:1789120847.066323:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120847.066329:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120847.066335:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa5d37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120847.066519:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11825:x1876028901394304:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 663us (831us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789120847.066534:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 236 00000040:00080000:3.0:1789120847.067200:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120847.067206:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120847.067813:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789120847.067824:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120847.068113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394432 00000100:00100000:0.0:1789120847.068124:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394432 00000100:00100000:0.0:1789120847.068208:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:0.0:1789120847.068218:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0246850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:2350:x1876028901394432:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120847.068235:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120847.068272:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa5d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b109 expref: 29 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120847.068291:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120847.068295:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120847.068359:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0246850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:2350:x1876028901394432:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 142us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120847.068367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789120847.075307:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120847.079366:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394688 00000100:00100000:0.0:1789120847.079386:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394688 00000100:00100000:0.0:1789120847.079471:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 64 00000100:00100000:0.0:1789120847.079484:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+28:11825:x1876028901394688:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789120847.079824:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11825:x1876028901394688:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 341us (4530us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789120847.079833:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 64 00010000:00010000:0.0:1789120847.085325:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120847.595393:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922348288:0@lo:400:kworker.0 00000100:00100000:0.0:1789120847.595490:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120847.595584:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120847.595608:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922348160:0@lo:400:kworker.0 00000100:00100000:0.0:1789120847.595638:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120847.595656:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922348672:0@lo:400:kworker.0 00000100:00100000:0.0:1789120847.595685:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120847.596027:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348672 00000100:00100000:3.0:1789120847.596036:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348672 00000100:00100000:3.0:1789120847.596104:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789120847.596115:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922348672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120847.596204:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922348672:12345-0@lo:400:kworker.0 Request processed in 91us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120847.596212:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789120847.596237:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120847.596251:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922348800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120847.596287:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120847.596336:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922348672:0@lo:400:kworker.0 00000100:00100000:3.0:1789120847.596372:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348800 00000100:00100000:3.0:1789120847.596376:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348800 00000100:00100000:3.0:1789120847.596400:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789120847.596407:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922348800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120847.596440:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120847.596476:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876028922348800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120847.596483:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789120847.596514:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922348800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120847.596709:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922348032:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.596852:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120847.596890:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922348544:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.596917:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120847.596941:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120847.596948:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922348416:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.596974:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120847.597002:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348288 00000100:00100000:1.0:1789120847.597007:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348288 00000100:00100000:1.0:1789120847.597047:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348160 00000100:00100000:1.0:1789120847.597051:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348160 00000100:00100000:1.0:1789120847.597064:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348544 00000100:00100000:1.0:1789120847.597066:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348544 00000100:00100000:1.0:1789120847.597082:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120847.597089:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597133:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922348288:12345-0@lo:400:kworker.0 Request processed in 44us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120847.597180:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120847.597198:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789120847.597205:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922348160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597238:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922348160:12345-0@lo:400:kworker.0 Request processed in 34us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120847.597244:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789120847.597255:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789120847.597261:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922348544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597306:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876028922348544:12345-0@lo:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120847.597312:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789120847.597331:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348416 00000100:00100000:1.0:1789120847.597334:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348416 00000100:00100000:1.0:1789120847.597362:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789120847.597369:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3320:x1876028922348416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597401:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd955a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3320:x1876028922348416:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120847.597408:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789120847.597430:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120847.597434:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120847.597456:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922348416:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597467:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922348544:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597496:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922348160:0@lo:400:kworker.0 00000100:00100000:1.0:1789120847.597507:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922348288:0@lo:400:kworker.0 00000100:00100000:3.0:1789120847.598537:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348032 00000100:00100000:3.0:1789120847.598547:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348032 00000100:00100000:3.0:1789120847.598594:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789120847.598604:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120847.598723:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3320:x1876028922348032:12345-0@lo:400:kworker.0 Request processed in 112us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120847.598732:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789120847.598891:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922348032:0@lo:400:kworker.0 00010000:00010000:3.0:1789120848.117594:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120848.303972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120848.304039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394816 00000100:00100000:2.0:1789120848.304043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120848.304051:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394816 00000100:00100000:2.0:1789120848.304089:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120848.304108:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120848.304113:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 322 00000100:00100000:0.0:1789120848.304124:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901394816:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120848.304129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120848.304240:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901394816:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120848.304249:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 322 00000100:00100000:1.0:1789120848.304347:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395072 00000100:00100000:1.0:1789120848.304353:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395072 00000100:00100000:1.0:1789120848.304404:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395200 00000100:00100000:1.0:1789120848.304408:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395200 00000100:00100000:1.0:1789120848.304433:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:1.0:1789120848.304440:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901395072:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120848.304473:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2351:x1876028901395072:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120848.304479:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:1.0:1789120848.304494:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:1.0:1789120848.304500:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5532d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901395200:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120848.304525:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5532d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2351:x1876028901395200:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120848.304532:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:1.0:1789120848.304551:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395328 00000100:00100000:1.0:1789120848.304556:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395328 00000100:00100000:2.0:1789120848.304576:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901394944 00000100:00100000:2.0:1789120848.304580:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901394944 00000100:00100000:1.0:1789120848.304594:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 151 00000100:00100000:1.0:1789120848.304600:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5532940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901395328:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:0.0:1789120848.304626:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120848.304642:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120848.304645:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120848.304718:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5532940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+5:2351:x1876028901395328:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 117us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120848.313805:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:2.0:1789120848.313837:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:2351:x1876028901394944:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120848.313953:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:2351:x1876028901394944:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 134us (9843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120848.313962:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 152 00000100:00100000:1.0:1789120848.314669:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 151 00000040:00080000:1.0:1789120849.041315:0:13016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120849.041326:0:13016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120849.041376:0:13016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789120849.041383:0:13016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789120849.130712:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120849.249690:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120849.249772:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395584 00000100:00100000:0.0:1789120849.249781:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395584 00000100:00100000:0.0:1789120849.249843:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 237 00000100:00100000:0.0:1789120849.249853:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5531e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+29:11845:x1876028901395584:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:0.0:1789120849.249873:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120849.249893:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b110 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120849.250000:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120849.250015:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120849.250040:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120849.250052:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789120849.250198:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa5d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b110 expref: 32 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120849.250213:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b110 expref: 31 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120849.250221:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120849.250224:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789120849.250228:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120849.250283:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5531e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:11845:x1876028901395584:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 432us (602us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789120849.250291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 237 00000100:00100000:2.0:1789120849.255823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120849.255922:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395712 00000100:00100000:1.0:1789120849.255942:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395712 00000100:00100000:1.0:1789120849.256000:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 238 00000100:00100000:1.0:1789120849.256010:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5532580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:11845:x1876028901395712:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:1.0:1789120849.256072:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256090:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256102:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256129:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256135:0:5859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256163:0:5859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256171:0:5859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120849.256174:0:5859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256181:0:5859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256198:0:5859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:1.0:1789120849.256200:0:5859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120849.256204:0:5859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.256221:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa5d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120849.256290:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5532580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+31:11845:x1876028901395712:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 282us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120849.256298:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 238 00000100:00100000:3.0:1789120849.352795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120849.352987:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395840 00000100:00100000:1.0:1789120849.352999:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395840 00000100:00100000:1.0:1789120849.353081:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:1.0:1789120849.353092:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901395840:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:1.0:1789120849.353115:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120849.353191:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5d5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b117 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120849.353225:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3d14c, atime: 0x6aa3d14c, ctime: 0x6aa3d14c, blocks: 0xb 00010000:00010000:1.0:1789120849.353251:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1789120849.353256:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120849.353269:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5d5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b117 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.353290:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5d5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b117 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120849.353318:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120849.353401:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2352:x1876028901395840:12345-192.168.206.9@tcp:101:cat.0 Request processed in 311us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120849.353430:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 71 00000100:00100000:3.0:1789120849.359528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120849.359704:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901395968 00000100:00100000:1.0:1789120849.359716:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901395968 00002000:00100000:1.0:1789120849.359793:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ffdc1f130c0 x1876028901395968/t0(0) o3->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:380/0 lens 488/0 e 0 to 0 dl 1789120860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120849.359806:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdc1f130c0 with x1876028901395968 ext(0->4095) 00002000:00010000:1.0:1789120849.359813:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdc1f130c0 00000100:00100000:1.0:1789120849.359851:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789120849.359868:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2351:x1876028901395968:12345-192.168.206.9@tcp:3:cat.0 00000100:00100000:1.0:1789120849.360389:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+8:2351:x1876028901395968:12345-192.168.206.9@tcp:3:cat.0 Request processed in 526us (876us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789120849.360397:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00002000:00100000:1.0:1789120849.360405:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ffdc1f130c0 x1876028901395968/t0(0) o3->76510092-6f58-4075-a7f3-7af5ca8b7da2@192.168.206.9@tcp:380/0 lens 488/4536 e 0 to 0 dl 1789120860 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120849.360415:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9ffdc1f130c0 with x1876028901395968 ext(0->4095) 00002000:00010000:1.0:1789120849.360419:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ffdc1f130c0 00010000:00010000:0.0:1789120850.155189:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789120850.716544:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1789120851.178894:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120851.180315:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922348928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120851.180572:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120851.184904:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922348928 00000100:00100000:0.0:1789120851.184918:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922348928 00000100:00100000:0.0:1789120851.184978:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120851.184988:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922348928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120851.185022:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120851.185098:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3319:x1876028922348928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120851.185106:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789120851.185670:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922348928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789120851.187222:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789120851.261210:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789120851.261246:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ffdbfbdf600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789120851.261262:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd90b08100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdbfbdf840 00000020:00080000:0.0:1789120851.261266:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ffd90b08f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ffdc1d2c000 00000020:00080000:0.0:1789120851.261306:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789120851.265423:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789120851.265628:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1789120851.330068:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1789120851.330087:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:1.0:1789120852.202717:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120852.716450:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922349440:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.716517:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.716600:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789120852.716606:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922349056:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.716636:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.716659:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922349568:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.716706:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.716747:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922349184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.716771:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.716786:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922349696:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.716805:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.716820:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120852.716999:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349440 00000100:00100000:1.0:1789120852.717006:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349440 00000100:00100000:1.0:1789120852.717048:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349696 00000100:00100000:1.0:1789120852.717051:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349696 00000100:00100000:1.0:1789120852.717082:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789120852.717091:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922349440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120852.717166:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922349440:12345-0@lo:400:kworker.0 Request processed in 52us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120852.717180:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789120852.717198:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789120852.717204:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922349696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120852.717248:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922349696:12345-0@lo:400:kworker.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120852.717255:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789120852.717275:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120852.717302:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789120852.717308:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffd955a7480, transno 4294967321 00000004:00080000:1.0:1789120852.717317:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffd955a52c0, transno 4294967322 00000004:00080000:1.0:1789120852.717321:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789120852.717341:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922349440:0@lo:400:kworker.0 00000100:00100000:0.0:1789120852.718028:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349056 00000100:00100000:0.0:1789120852.718032:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349056 00000100:00100000:0.0:1789120852.718066:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789120852.718074:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922349056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120852.718121:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd87395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922349056:12345-0@lo:400:kworker.0 Request processed in 48us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120852.718128:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789120852.718177:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349568 00000100:00100000:0.0:1789120852.718181:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349568 00000100:00100000:0.0:1789120852.718226:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349184 00000100:00100000:0.0:1789120852.718230:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349184 00000100:00100000:0.0:1789120852.718249:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789120852.718255:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922349568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120852.718286:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922349568:12345-0@lo:400:kworker.0 Request processed in 31us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120852.718292:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789120852.718304:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789120852.718311:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922349184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120852.718335:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922349184:12345-0@lo:400:kworker.0 Request processed in 26us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120852.718342:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789120852.718380:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922349824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120852.718410:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120852.718443:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349824 00000100:00100000:0.0:1789120852.718446:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349824 00000100:00100000:0.0:1789120852.718471:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120852.718478:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922349824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120852.718504:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789120852.718538:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922349824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120852.718543:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789120852.718561:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120852.718586:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789120852.718591:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb5530f00, transno 4294967310 00000100:00100000:0.0:1789120852.718608:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922349824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120852.718961:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922349056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120852.718977:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922349568:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.719097:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922349312:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.719133:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.719174:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922349184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.719185:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922349696:0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.719216:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349312 00000100:00100000:3.0:1789120852.719219:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349312 00000100:00100000:3.0:1789120852.719249:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789120852.719255:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922349312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120852.719292:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922349312:12345-0@lo:400:kworker.0 Request processed in 36us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120852.719298:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789120852.719321:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922349312:0@lo:400:kworker.0 00000100:00080000:0.0:1789120852.722862:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120853.227691:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120853.428350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432046:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432070:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.432134:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396608 00000100:00100000:3.0:1789120853.432160:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396608 00000100:00100000:3.0:1789120853.432211:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396224 00000100:00100000:3.0:1789120853.432214:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396224 00000100:00100000:3.0:1789120853.432227:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396736 00000100:00100000:3.0:1789120853.432229:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396736 00000100:00100000:3.0:1789120853.432243:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 156 00000100:00100000:3.0:1789120853.432251:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901396608:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120853.432314:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:2349:x1876028901396608:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120853.432328:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 156 00000100:00100000:3.0:1789120853.432345:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 157 00000100:00100000:3.0:1789120853.432351:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:2349:x1876028901396224:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120853.432380:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:2349:x1876028901396224:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120853.432386:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 157 00000100:00100000:3.0:1789120853.432398:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 239 00000100:00100000:3.0:1789120853.432402:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11490:x1876028901396736:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789120853.432447:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11490:x1876028901396736:12345-192.168.206.9@tcp:60:lhsmtool_posix.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120853.432454:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 239 00000100:00080000:3.0:1789120853.432475:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120853.432699:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396352 00000100:00100000:1.0:1789120853.432704:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396352 00000100:00100000:1.0:1789120853.432750:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396480 00000100:00100000:1.0:1789120853.432753:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396480 00000100:00100000:1.0:1789120853.432774:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:1.0:1789120853.432781:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901396352:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120853.432817:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2349:x1876028901396352:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 36us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120853.432823:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:1.0:1789120853.432835:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:1.0:1789120853.432841:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901396480:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120853.432862:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1f13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2349:x1876028901396480:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 21us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120853.432875:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00080000:3.0:1789120853.433057:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120853.433061:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120853.438059:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396096 00000100:00100000:2.0:1789120853.438073:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396096 00000100:00100000:2.0:1789120853.438137:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 324 00000100:00100000:2.0:1789120853.438161:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901396096:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120853.438242:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2349:x1876028901396096:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 83us (10069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120853.438250:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 324 00000100:00100000:0.0:1789120853.441844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120853.442019:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901396992 00000100:00100000:1.0:1789120853.442028:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901396992 00000100:00100000:1.0:1789120853.442081:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:1.0:1789120853.442091:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:11490:x1876028901396992:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789120853.442604:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:11490:x1876028901396992:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 512us (765us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789120853.442613:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 65 00000100:00100000:0.0:1789120853.572014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120853.573087:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397120 00000100:00100000:3.0:1789120853.573099:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397120 00000100:00100000:3.0:1789120853.573183:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 240 00000100:00100000:3.0:1789120853.573193:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+5:12296:x1876028901397120:12345-192.168.206.9@tcp:101:lsof.0 00010000:00010000:3.0:1789120853.573213:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120853.573235:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b11e expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573296:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573311:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573337:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120853.573515:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789120853.573520:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120853.573872:0:8217:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573898:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa5d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b11e expref: 7 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573917:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b11e expref: 6 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120853.573925:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:3.0:1789120853.573928:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120853.573990:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691c00, rc 0) 00000100:00100000:3.0:1789120853.574095:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62440a6e-232c-434d-8868-70f19c1fd072+6:12296:x1876028901397120:12345-192.168.206.9@tcp:101:lsof.0 Request processed in 903us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120853.574103:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 240 00000040:00080000:2.0:1789120854.250856:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120854.250878:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120854.251212:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789120854.251219:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789120854.269136:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120855.276686:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120856.298754:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120856.298775:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922349952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120856.298838:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120856.299083:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922349952 00000100:00100000:3.0:1789120856.299090:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922349952 00000100:00100000:3.0:1789120856.299178:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789120856.299187:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922349952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120856.299218:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120856.299265:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922349952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120856.299288:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789120856.299334:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922349952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789120856.299411:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789120856.300635:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120856.393020:0:13218:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:00:54 (1789120854) 00000001:00080000:2.0:1789120856.414688:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789120856.415038:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789120856.416113:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789120856.416125:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789120857.327165:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120857.834892:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922350080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120857.835061:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120857.835407:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350080 00000100:00100000:3.0:1789120857.835416:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350080 00000100:00100000:3.0:1789120857.835476:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789120857.835486:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922350080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120857.835519:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120857.835565:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922350080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120857.835572:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789120857.835807:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.835839:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120857.835862:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120857.835867:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922350592:0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.835890:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120857.836050:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350464 00000100:00100000:2.0:1789120857.836054:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350464 00000100:00100000:2.0:1789120857.836086:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789120857.836094:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922350464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.836130:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922350464:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120857.836137:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1789120857.836343:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120857.836348:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120857.836374:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922350336:0@lo:400:kworker.0 00000100:00100000:0.0:1789120857.836403:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120857.836432:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350336 00000100:00100000:0.0:1789120857.836436:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350336 00000100:00100000:0.0:1789120857.836459:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789120857.836465:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120857.836497:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922350336:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120857.836503:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789120857.836536:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922350336:0@lo:400:kworker.0 00000100:00100000:0.0:1789120857.836570:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffda31ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922350080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120857.836800:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922350208:0@lo:400:kworker.0 00000100:00100000:3.0:1789120857.836837:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120857.836871:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922350720:0@lo:400:kworker.0 00000100:00100000:3.0:1789120857.836893:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120857.837513:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350208 00000100:00100000:0.0:1789120857.837520:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350208 00000100:00100000:0.0:1789120857.837556:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789120857.837563:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922350208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120857.837603:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3317:x1876028922350208:12345-0@lo:400:kworker.0 Request processed in 40us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120857.837610:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789120857.837726:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832ba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922350208:0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.838015:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350720 00000100:00100000:2.0:1789120857.838020:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350720 00000100:00100000:2.0:1789120857.838061:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789120857.838067:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda31ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922350720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.838116:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda31ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876028922350720:12345-0@lo:400:kworker.0 Request processed in 49us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120857.838122:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789120857.838160:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876028922350720:0@lo:400:kworker.0 00000100:00080000:0.0:1789120857.838478:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120857.838837:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350592 00000100:00100000:2.0:1789120857.838842:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350592 00000100:00100000:2.0:1789120857.838882:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789120857.838914:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922350592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.838963:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922350592:12345-0@lo:400:kworker.0 Request processed in 52us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120857.838970:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789120857.839003:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922350592:0@lo:400:kworker.0 00000100:00100000:2.0:1789120857.839013:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922350464:0@lo:400:kworker.0 00010000:00010000:2.0:1789120858.347315:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120858.545740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120858.545783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120858.545819:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120858.545857:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120858.545880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120858.545910:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397504 00000100:00100000:0.0:1789120858.545918:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397504 00000100:00100000:0.0:1789120858.545984:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397632 00000100:00100000:0.0:1789120858.545988:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397632 00000100:00100000:0.0:1789120858.546011:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:0.0:1789120858.546021:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901397504:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120858.546090:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2352:x1876028901397504:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 70us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120858.546097:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:0.0:1789120858.546129:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00100000:0.0:1789120858.546136:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901397632:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120858.546210:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2352:x1876028901397632:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120858.546217:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 90 00000100:00080000:0.0:1789120858.546233:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120858.546236:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120858.546398:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397760 00000100:00100000:3.0:1789120858.546402:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397760 00000100:00100000:3.0:1789120858.546444:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397376 00000100:00100000:3.0:1789120858.546448:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397376 00000100:00100000:3.0:1789120858.546466:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:3.0:1789120858.546473:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+6:2352:x1876028901397760:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120858.546517:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62440a6e-232c-434d-8868-70f19c1fd072+6:2352:x1876028901397760:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 45us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120858.546523:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 161 00000100:00100000:3.0:1789120858.546536:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:3.0:1789120858.546542:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:2352:x1876028901397376:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120858.546570:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:2352:x1876028901397376:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120858.546576:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 162 00000100:00100000:2.0:1789120858.546818:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901397248 00000100:00100000:2.0:1789120858.546823:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901397248 00000100:00100000:2.0:1789120858.546860:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 326 00000100:00100000:2.0:1789120858.546868:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901397248:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120858.546910:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2352:x1876028901397248:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 43us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120858.546917:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 326 00000100:00080000:0.0:1789120858.547339:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789120859.371479:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120860.395767:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120860.681506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120860.681756:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901398016 00000100:00100000:3.0:1789120860.681765:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901398016 00000100:00100000:3.0:1789120860.681836:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00100000:3.0:1789120860.681848:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+18:12517:x1876028901398016:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:3.0:1789120860.682541:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:12517:x1876028901398016:12345-192.168.206.9@tcp:35:umount.0 Request processed in 693us (1041us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789120860.682551:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 66 00000100:00080000:0.0:1789120860.682669:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120860.691031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120860.691277:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901398272 00000100:00100000:1.0:1789120860.691287:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901398272 00000100:00100000:1.0:1789120860.691377:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:1.0:1789120860.691388:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+19:12517:x1876028901398272:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:1.0:1789120860.691922:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:12517:x1876028901398272:12345-192.168.206.9@tcp:35:umount.0 Request processed in 534us (903us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789120860.691932:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 67 00000100:00100000:2.0:1789120860.694743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120860.696634:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901398528 00000100:00100000:1.0:1789120860.696658:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901398528 00000100:00100000:1.0:1789120860.696742:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:1.0:1789120860.696754:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0db0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+20:12517:x1876028901398528:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:1.0:1789120860.697232:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0db0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:12517:x1876028901398528:12345-192.168.206.9@tcp:35:umount.0 Request processed in 479us (2511us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789120860.697248:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 68 00000100:00100000:0.0:1789120860.701846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120860.702346:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901398784 00000100:00100000:1.0:1789120860.702357:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901398784 00000100:00100000:1.0:1789120860.702414:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:1.0:1789120860.702426:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+21:12517:x1876028901398784:12345-192.168.206.9@tcp:35:umount.0 00000100:00100000:1.0:1789120860.703562:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:12517:x1876028901398784:12345-192.168.206.9@tcp:35:umount.0 Request processed in 1135us (1720us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789120860.703573:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 69 00000100:00100000:0.0:1789120860.714656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120860.714768:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120860.714930:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120860.715000:0:12923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901398912 00000100:00100000:1.0:1789120860.715012:0:12923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901398912 00000100:00100000:1.0:1789120860.715086:0:12923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901399168 00000100:00100000:1.0:1789120860.715090:0:12923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901399168 00000100:00100000:1.0:1789120860.715117:0:12923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789120860.715128:0:12923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10de64a-96fd-4380-b3ad-f12a53725f77+14:2351:x1876028901398912:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120860.715186:0:12923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120860.715214:0:12923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691e00/0x13cfa3d77faa4d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac94 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120860.715246:0:12923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120860.715261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:2.0:1789120860.715283:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901399168:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120860.715302:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789120860.715319:0:12923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10de64a-96fd-4380-b3ad-f12a53725f77+13:2351:x1876028901398912:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 190us (674us total) trans 0 rc 0/0 00010000:00010000:2.0:1789120860.715327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5400/0x13cfa3d77faa4fed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad6d expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120860.715339:0:12923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00010000:00010000:2.0:1789120860.715355:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120860.716848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10de64a-96fd-4380-b3ad-f12a53725f77+11:2351:x1876028901399168:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 1568us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120860.716862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789120860.717138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120860.717351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901399040 00000100:00100000:3.0:1789120860.717361:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901399040 00000100:00100000:2.0:1789120860.718628:0:12923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789120860.718653:0:12923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10de64a-96fd-4380-b3ad-f12a53725f77+11:2351:x1876028901399040:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120860.718676:0:12923:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120860.718715:0:12923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390b400/0x13cfa3d77faa4d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac5c expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120860.718746:0:12923:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120860.719163:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901399296 00000100:00100000:3.0:1789120860.719172:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901399296 00000100:00100000:3.0:1789120860.719320:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:3.0:1789120860.719332:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+5:2348:x1876028901399296:12345-192.168.206.9@tcp:9:umount.0 00000020:00000080:3.0:1789120860.719364:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa50b1 00000100:00080000:3.0:1789120860.719375:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789120860.719438:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789120860.720418:0:12923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2351:x1876028901399040:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 1769us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120860.720431:0:12923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00010000:00010000:2.0:1789120860.720472:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789120860.720505:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120860.720895:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5533c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+2:2348:x1876028901399296:12345-192.168.206.9@tcp:9:umount.0 Request processed in 1564us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120860.721019:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 72 00000100:00100000:0.0:1789120860.730582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120860.730851:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901399680 00000100:00100000:1.0:1789120860.730864:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901399680 00000100:00100000:1.0:1789120860.730957:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789120860.730969:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5530f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2348:x1876028901399680:12345-192.168.206.9@tcp:9:umount.0 00000020:00000080:1.0:1789120860.731024:0:8216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa5312 00000020:00010000:1.0:1789120860.731034:0:8216:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ffd9059a800: total 0 00000100:00080000:1.0:1789120860.731040:0:8216:0:(import.c:65:import_set_state_nolock()) ffff9ffd9059a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789120860.731085:0:8216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1789120860.731416:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1789120860.731465:0:12067:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ffd9059a800: total 0 00010000:00010000:0.0:1789120860.731508:0:12067:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ffd9059a800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789120860.731573:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa56b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af42 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.731635:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5d5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b117 expref: 5 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.731651:0:12067:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ffd9059a800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789120860.731664:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120860.731666:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120860.731668:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120860.732078:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5530f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76510092-6f58-4075-a7f3-7af5ca8b7da2+2:2348:x1876028901399680:12345-192.168.206.9@tcp:9:umount.0 Request processed in 1109us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120860.732088:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 73 00000100:00100000:1.0:1789120860.759084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120860.759256:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901400704 00000100:00100000:3.0:1789120860.759269:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901400704 00000100:00100000:3.0:1789120860.759346:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 241 00000100:00100000:3.0:1789120860.759358:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+22:2348:x1876028901400704:12345-192.168.206.9@tcp:39:umount.0 00000020:00000080:3.0:1789120860.759405:0:5858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4d0e 00000020:00010000:3.0:1789120860.759426:0:5858:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ffdbfb58800: total 0 00000100:00080000:3.0:1789120860.759433:0:5858:0:(import.c:65:import_set_state_nolock()) ffff9ffdbfb5c800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789120860.759645:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ffdbfb58800: total 0 00010000:00010000:1.0:1789120860.759718:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ffdbfb58800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789120860.759923:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120860.759934:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789120860.759946:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4400/0x13cfa3d77faa5733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af65 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120860.759977:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ffd84cf3f00) 00010000:00010000:1.0:1789120860.759981:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120860.759986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4e00/0x13cfa3d77faa5a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b037 expref: 20 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1789120860.760059:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00010000:00010000:0.0:1789120860.760645:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120860.760651:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120860.760662:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b600/0x13cfa3d77faa5596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aef5 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.760695:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120860.760698:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789120860.760703:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a200/0x13cfa3d77faa5087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad97 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.760717:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ffd9fd7c000) 00010000:00010000:0.0:1789120860.760719:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789120860.760733:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390b800/0x13cfa3d77faa5374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ae69 expref: 19 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762403:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120860.762533:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789120860.762545:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4bc00/0x13cfa3d77faa5d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b110 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762595:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120860.762598:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120860.762603:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa5d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b102 expref: 17 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762615:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:0.0:1789120860.762618:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120860.762622:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390aa00/0x13cfa3d77faa5717 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af5e expref: 16 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762633:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd831cfa00) 00010000:00010000:0.0:1789120860.762635:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120860.762638:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8390bc00/0x13cfa3d77faa5033 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad82 expref: 15 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762759:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120860.762762:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120860.762767:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a600/0x13cfa3d77faa5676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af2d expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762780:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7ca00) 00010000:00010000:0.0:1789120860.762783:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120860.762786:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4a400/0x13cfa3d77faa5017 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad7b expref: 13 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762800:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ffd84cf3400) 00010000:00010000:0.0:1789120860.762802:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789120860.762813:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb5fa4a00/0x13cfa3d77faa56a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8af3b expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762831:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ffd84cf3e00) 00010000:00010000:0.0:1789120860.762834:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120860.762838:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb800/0x13cfa3d77faa5c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b0ca expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120860.762868:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ffdbfb58800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789120860.762901:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120860.762904:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120860.762907:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120860.763119:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76510092-6f58-4075-a7f3-7af5ca8b7da2+7:2348:x1876028901400704:12345-192.168.206.9@tcp:39:umount.0 Request processed in 3753us (4042us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789120860.763135:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 241 00000001:00100000:3.0:1789120860.972719:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:3.0:1789120860.972732:0:7651:0:(genops.c:885:class_export_put()) final put ffff9ffdb990c800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:2.0:1789120860.972817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb990c800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-OST0001 00000020:00000080:2.0:1789120860.972877:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb990f800 for lustre-OST0001 00010000:00010000:2.0:1789120861.431039:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120861.431426:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922350848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120861.431493:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120861.431937:0:12101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350848 00000100:00100000:2.0:1789120861.431945:0:12101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350848 00000100:00100000:2.0:1789120861.432008:0:12101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789120861.432017:0:12101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922350848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120861.432095:0:12101:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120861.432164:0:12101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922350848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120861.432172:0:12101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789120861.432345:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120861.432385:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdbfb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922350848:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789120861.468396:0:13219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789120861.468420:0:13219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000001:00080000:2.0:1789120861.468428:0:13219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789120861.468447:0:13219:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb58800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:3.0:1789120861.470663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb58800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-MDT0000 00000020:00000080:3.0:1789120861.470819:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdbfb5c800 for lustre-MDT0000 00000001:00100000:0.0:1789120861.512457:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:0.0:1789120861.512466:0:6729:0:(genops.c:885:class_export_put()) final put ffff9ffd9059a800/76510092-6f58-4075-a7f3-7af5ca8b7da2 00000020:00000080:0.0:1789120861.512494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd9059a800/76510092-6f58-4075-a7f3-7af5ca8b7da2 for lustre-OST0000 00000020:00000080:0.0:1789120861.512538:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd9059a000 for lustre-OST0000 00010000:00010000:0.0:1789120862.443002:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120862.564266:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120862.564311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120862.564345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120862.564390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901400832 00000100:00100000:3.0:1789120862.564398:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901400832 00000100:00100000:3.0:1789120862.564449:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401088 00000100:00100000:3.0:1789120862.564452:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401088 00000100:00100000:3.0:1789120862.564465:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901400960 00000100:00100000:3.0:1789120862.564467:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901400960 00000100:00100000:3.0:1789120862.564482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:3.0:1789120862.564490:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+12:2352:x1876028901400832:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120862.564505:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120862.564524:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa4de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8aca9 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120862.564541:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120862.564587:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832ba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+11:2352:x1876028901400832:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 98us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120862.564595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:3.0:1789120862.564611:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120862.564617:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+10:2352:x1876028901401088:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120862.564625:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120862.564633:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa4fe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ad66 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120862.564642:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120862.564702:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+9:2352:x1876028901401088:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 83us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120862.564709:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120862.564722:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:3.0:1789120862.564728:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+8:2352:x1876028901400960:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120862.564743:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120862.564753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99ba200/0x13cfa3d77faa4de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8acd3 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120862.564762:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120862.564779:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e10de64a-96fd-4380-b3ad-f12a53725f77+7:2352:x1876028901400960:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 51us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120862.564785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789120862.571948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120862.572546:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401344 00000100:00100000:2.0:1789120862.572557:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401344 00000100:00100000:2.0:1789120862.572640:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 242 00000100:00100000:2.0:1789120862.572660:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+6:2348:x1876028901401344:12345-192.168.206.9@tcp:39:umount.0 00000020:00000080:2.0:1789120862.572708:0:5859:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4df5 00000020:00010000:2.0:1789120862.572715:0:5859:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ffd9d39f000: total 0 00000100:00080000:2.0:1789120862.572720:0:5859:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d398000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789120862.572750:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1789120862.573096:0:5845:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ffd9d39f000: total 0 00010000:00010000:1.0:1789120862.573101:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120862.573201:0:5845:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ffd9d39f000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789120862.573237:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd831cfc00) 00010000:00010000:1.0:1789120862.573241:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120862.573249:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81691c00/0x13cfa3d77faa5d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b11e expref: 5 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120862.573291:0:5845:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ffd9d39f000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789120862.573304:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120862.573306:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120862.573308:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789120862.573613:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120862.574055:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62440a6e-232c-434d-8868-70f19c1fd072+3:2348:x1876028901401344:12345-192.168.206.9@tcp:39:umount.0 Request processed in 1404us (2113us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789120862.574067:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 242 00000100:00100000:1.0:1789120862.597406:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120862.597519:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401600 00000100:00100000:0.0:1789120862.597528:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401600 00000100:00100000:0.0:1789120862.597624:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 327 00000100:00100000:0.0:1789120862.597634:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+7:2348:x1876028901401600:12345-192.168.206.9@tcp:251:umount.0 00000020:00000080:0.0:1789120862.597687:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4ceb 00000020:00010000:0.0:1789120862.597694:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ffc83f23800: total 0 00000100:00080000:0.0:1789120862.597699:0:5851:0:(import.c:65:import_set_state_nolock()) ffff9ffc83f22800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789120862.597775:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10de64a-96fd-4380-b3ad-f12a53725f77+3:2348:x1876028901401600:12345-192.168.206.9@tcp:251:umount.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120862.597783:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 327 00000020:00010000:1.0:1789120862.597993:0:5846:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ffc83f23800: total 0 00010000:00010000:1.0:1789120862.598048:0:5846:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ffc83f23800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789120862.598082:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5600/0x13cfa3d77faa4da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8ac9b expref: 2 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120862.598099:0:5846:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ffc83f23800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789120862.598109:0:5846:0:(genops.c:885:class_export_put()) final put ffff9ffc83f23800/e10de64a-96fd-4380-b3ad-f12a53725f77 00010000:00010000:1.0:1789120862.598129:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120862.598132:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120862.598134:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120862.598238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc83f23800/e10de64a-96fd-4380-b3ad-f12a53725f77 for MGS 00000020:00000080:3.0:1789120862.598448:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffc83f22800 for MGS 00000100:00100000:1.0:1789120862.955138:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922351232:0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.955227:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120862.955287:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120862.955294:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922351360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.955320:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120862.955359:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351232 00000100:00100000:1.0:1789120862.955366:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351232 00000100:00100000:1.0:1789120862.955415:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789120862.955424:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922351232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.955471:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922351232:12345-0@lo:400:kworker.0 Request processed in 47us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.955494:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789120862.955517:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351360 00000100:00100000:1.0:1789120862.955520:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351360 00000100:00100000:1.0:1789120862.955542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789120862.955548:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922351360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.955577:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922351360:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.955583:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789120862.955596:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120862.955624:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922351360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.955633:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922351232:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.955798:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.955830:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120862.955853:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922351488:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.955875:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120862.955893:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789120862.955898:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.955918:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120862.955932:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922351616:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.955950:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120862.955975:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351488 00000100:00100000:2.0:1789120862.955978:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351488 00000100:00100000:2.0:1789120862.956003:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351104 00000100:00100000:2.0:1789120862.956006:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351104 00000100:00100000:2.0:1789120862.956021:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789120862.956027:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.956066:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922351488:12345-0@lo:400:kworker.0 Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120862.956072:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789120862.956086:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789120862.956091:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922351104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.956113:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922351104:12345-0@lo:400:kworker.0 Request processed in 22us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120862.956124:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789120862.956158:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351616 00000100:00100000:2.0:1789120862.956161:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351616 00000100:00100000:2.0:1789120862.956183:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789120862.956189:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922351616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.956230:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd954f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922351616:12345-0@lo:400:kworker.0 Request processed in 40us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120862.956235:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789120862.956261:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1f103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.956270:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922351616:0@lo:400:kworker.0 00000100:00100000:2.0:1789120862.956278:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922351488:0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.957552:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922350976 00000100:00100000:1.0:1789120862.957559:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922350976 00000100:00100000:1.0:1789120862.957604:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789120862.957613:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120862.957690:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd9d2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3319:x1876028922350976:12345-0@lo:400:kworker.0 Request processed in 77us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.957697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789120862.957735:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120862.957746:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120862.957777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120862.957808:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351744 00000100:00100000:1.0:1789120862.957812:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351744 00000100:00100000:1.0:1789120862.957838:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789120862.957845:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922351744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120862.957889:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120862.957927:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922351744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.957934:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789120862.957956:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120862.957960:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120862.957987:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120862.958125:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922350976:0@lo:400:kworker.0 00010000:00010000:3.0:1789120863.473285:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789120864.446136:0:13431:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789120864.472332:0:13431:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789120864.472377:0:13431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472392:0:13431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472418:0:13431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472425:0:13431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472448:0:13431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789120864.472454:0:13431:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789120864.472480:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120864.472487:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472494:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691a00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120864.472497:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472506:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120864.472513:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120864.472519:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789120864.472522:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789120864.472525:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789120864.472557:0:5845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472563:0:5845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120864.472594:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472601:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81691a00/0x13cfa3d77faa4d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d77 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.472613:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120864.472615:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120864.472617:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120864.472636:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922351872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120864.472711:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.474354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922351872 00000100:00100000:3.0:1789120864.474365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922351872 00000100:00100000:3.0:1789120864.474434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120864.474443:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+19:3318:x1876028922351872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120864.474458:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120864.474473:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5800/0x13cfa3d77faa4d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d70 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.474490:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120864.474550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3318:x1876028922351872:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.474557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120864.474623:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83463840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922351872:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789120864.475201:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789120864.475207:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789120864.475215:0:13431:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789120864.475236:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffdb48b1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789120864.476009:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922352000:0@lo:39:umount.0 00000100:00100000:3.0:1789120864.476064:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120864.477052:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352000 00000100:00100000:1.0:1789120864.477061:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352000 00000100:00100000:1.0:1789120864.477123:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789120864.477133:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876028922352000:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789120864.477180:0:5857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4afa 00000100:00080000:1.0:1789120864.477188:0:5857:0:(import.c:65:import_set_state_nolock()) ffff9ffdb4871800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789120864.477258:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3316:x1876028922352000:12345-0@lo:39:umount.0 Request processed in 126us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120864.477266:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:1.0:1789120864.477277:0:5857:0:(genops.c:885:class_export_put()) final put ffff9ffdbaae1800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789120864.477308:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789120864.477415:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdb48b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789120864.477428:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922352000:0@lo:39:umount.0 00000100:00080000:3.0:1789120864.477467:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789120864.477470:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789120864.477475:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789120864.478526:0:13431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478543:0:13431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478550:0:13431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478556:0:13431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478580:0:13431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789120864.478597:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120864.478602:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478609:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120864.478613:0:12067:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478620:0:12067:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120864.478627:0:12067:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120864.478647:0:12067:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789120864.478650:0:12067:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789120864.478690:0:12067:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478696:0:12067:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120864.478717:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478722:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa4d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.478737:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120864.478738:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120864.478740:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120864.478752:0:13431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789120864.479290:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbaae1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789120864.479351:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb4871800 for lustre-MDT0000 00000100:00100000:0.0:1789120864.479371:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922352128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120864.479427:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120864.479486:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352128 00000100:00100000:0.0:1789120864.479491:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352128 00000100:00100000:0.0:1789120864.479574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120864.479581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3319:x1876028922352128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120864.479591:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120864.479604:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb5fa5a00/0x13cfa3d77faa4d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d7e expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120864.479614:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120864.479645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3319:x1876028922352128:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120864.479652:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120864.479698:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71bf207b-8b16-4d55-83e2-f8c047f616c0:3319:1876028922352128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120864.480248:0:13431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.480254:0:13431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.480260:0:13431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.481739:0:13431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789120864.497034:0:13431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497077:0:13431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497083:0:13431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497090:0:13431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497115:0:13431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789120864.497123:0:13431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497129:0:13431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497134:0:13431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497140:0:13431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120864.497172:0:13431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789120864.497177:0:13431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789120864.497184:0:13431:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789120864.497224:0:13431:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789120864.497229:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789120864.497233:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789120864.497238:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1789120864.497251:0:13431:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ffda0a49000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789120864.497256:0:13431:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ffc81842000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789120864.497263:0:13431:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ffd9d39f000 62440a6e-232c-434d-8868-70f19c1fd072 192.168.206.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789120864.497267:0:13431:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ffdb9aa1a48) has exports, disconnecting them 00000020:00080000:3.0:1789120864.497272:0:13431:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ffda0a49000), last request at 1789120862 00000020:00000080:3.0:1789120864.497279:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4c6d 00000100:00080000:3.0:1789120864.497297:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffda0a4d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789120864.497345:0:13431:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffda0a49000): rc 0 00000020:00000080:3.0:1789120864.497347:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffda0a49000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789120864.497357:0:13431:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ffc81842000), last request at 1789120862 00000020:00000080:3.0:1789120864.497361:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4ba2 00000100:00080000:3.0:1789120864.497366:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffc81841800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789120864.497375:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffda0a49000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789120864.497424:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffda0a4d000 for lustre-MDT0000 00000020:00080000:3.0:1789120864.497435:0:13431:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc81842000): rc 0 00000020:00000080:3.0:1789120864.497437:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffc81842000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789120864.497448:0:13431:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb0ac1d07ae0 00000020:00000080:3.0:1789120864.497457:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc81842000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789120864.497478:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffc81841800 for lustre-MDT0000 00000100:00080000:3.0:1789120864.497499:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789120864.497503:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789120864.497515:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789120864.497586:0:13431:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789120864.497610:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffdb48b2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789120864.497625:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789120864.497627:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789120864.497634:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789120864.497725:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922352256:0@lo:9:umount.0 00000100:00100000:3.0:1789120864.497790:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.497843:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352256 00000100:00100000:3.0:1789120864.497864:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352256 00000100:00100000:3.0:1789120864.497916:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120864.497925:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876028922352256:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789120864.497946:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4bef 00000100:00080000:3.0:1789120864.497951:0:6707:0:(import.c:65:import_set_state_nolock()) ffff9ffc819e2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789120864.497974:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789120864.498310:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3316:x1876028922352256:12345-0@lo:9:umount.0 Request processed in 386us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.498319:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789120864.498338:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120864.498368:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdb48b2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789120864.498376:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789120864.498378:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789120864.498382:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922352256:0@lo:9:umount.0 00000100:00080000:3.0:1789120864.498404:0:13431:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789120864.498414:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffda0b5e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789120864.498431:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922352384:0@lo:9:umount.0 00000100:00100000:3.0:1789120864.498457:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789120864.498515:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ffdb9aa1a48) has no exports 00010000:00010000:1.0:1789120864.499049:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789120864.499059:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499069:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149ae00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120864.499074:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499083:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120864.499104:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120864.499110:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789120864.499113:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789120864.499116:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789120864.499166:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499174:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120864.499189:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499196:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ae00/0x13cfa3d77faa4ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4cac expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499212:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789120864.499216:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499222:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4c00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120864.499225:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499232:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120864.499238:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120864.499254:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789120864.499257:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789120864.499259:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789120864.499276:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499282:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120864.499298:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499304:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4c00/0x13cfa3d77faa4fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4fdf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499328:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120864.499332:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499338:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690c00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:1.0:1789120864.499341:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499348:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120864.499354:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120864.499360:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789120864.499362:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789120864.499364:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789120864.499385:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499391:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120864.499396:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499403:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81690c00/0x13cfa3d77faa4a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4a60 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120864.499414:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120864.499415:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120864.499417:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120864.500910:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352384 00000100:00100000:1.0:1789120864.500920:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352384 00000100:00100000:1.0:1789120864.500979:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789120864.500989:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876028922352384:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789120864.501015:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4cd6 00000100:00080000:1.0:1789120864.501023:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9ffdb990a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789120864.501055:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789120864.501417:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3316:x1876028922352384:12345-0@lo:9:umount.0 Request processed in 429us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120864.501426:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1789120864.501453:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120864.501939:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922352640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120864.501979:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120864.502032:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120864.502039:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922352768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120864.502059:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120864.502236:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352640 00000100:00100000:2.0:1789120864.502242:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352640 00000100:00100000:2.0:1789120864.502274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352768 00000100:00100000:2.0:1789120864.502277:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352768 00000100:00100000:2.0:1789120864.502297:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120864.502305:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+18:3317:x1876028922352640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120864.502316:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120864.502346:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa4fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4fd8 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.502359:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120864.502390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+17:3317:x1876028922352640:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120864.502397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120864.502413:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120864.502419:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+16:3317:x1876028922352768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120864.502426:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120864.502434:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8148a000/0x13cfa3d77faa4a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4a59 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120864.502445:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120864.502465:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:3317:x1876028922352768:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120864.502471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120864.502499:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922352768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120864.502508:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71bf207b-8b16-4d55-83e2-f8c047f616c0:3317:1876028922352640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120864.502527:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120864.502530:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120864.503915:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120864.503948:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922352512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120864.504007:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120864.504080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922352512 00000100:00100000:0.0:1789120864.504086:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922352512 00000100:00100000:0.0:1789120864.504180:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120864.504188:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+15:3320:x1876028922352512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120864.504199:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120864.504227:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4b800/0x13cfa3d77faa4cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4ca5 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120864.504243:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120864.504274:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71bf207b-8b16-4d55-83e2-f8c047f616c0+14:3320:x1876028922352512:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000040:00080000:1.0:1789120864.504281:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:0.0:1789120864.504281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:1.0:1789120864.504286:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789120864.504339:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922352512:0@lo:103:ldlm_bl.0 00000040:00080000:1.0:1789120864.504672:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789120864.504679:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:3.0:1789120864.504842:0:5853:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120864.504879:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffda0b5e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789120864.504898:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789120864.504900:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789120864.504904:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922352384:0@lo:9:umount.0 00000020:00080000:3.0:1789120864.540704:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ffdb9aa1a48) has no exports 00000020:00000080:3.0:1789120864.629743:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4ab4 00000020:00000080:3.0:1789120864.629760:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdafde6800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789120864.629833:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789120864.631243:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789120864.631257:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789120864.631261:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ffd9cd1b490) has no exports 00000020:00000080:3.0:1789120864.631673:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4aad 00000020:00000080:3.0:1789120864.631681:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdbaae1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789120864.631750:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdafde6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789120864.639736:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbaae1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789120864.643962:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789120864.643981:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789120864.643988:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdbaae0000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789120864.643993:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbaae0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789120864.644007:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789120865.516525:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789120866.091556:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789120866.091572:0:7651:0:(genops.c:885:class_export_put()) final put ffff9ffdb990b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789120866.091663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb990b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789120866.091720:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb990a800 for lustre-OST0001 00010000:00010000:2.0:1789120866.543964:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789120866.583872:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789120866.583882:0:6729:0:(genops.c:885:class_export_put()) final put ffff9ffc819e5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789120866.583915:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc819e5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789120866.583960:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffc819e2000 for lustre-OST0000 00000001:00100000:0.0:1789120866.585132:0:13220:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62440a6e-232c-434d-8868-70f19c1fd072 00000001:00080000:0.0:1789120866.585180:0:13220:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789120866.585185:0:13220:0:(genops.c:885:class_export_put()) final put ffff9ffd9d39f000/62440a6e-232c-434d-8868-70f19c1fd072 00000020:00000080:1.0:1789120866.585377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd9d39f000/62440a6e-232c-434d-8868-70f19c1fd072 for lustre-MDT0000 00000020:00000080:1.0:1789120866.585425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd9d398000 for lustre-MDT0000 00000020:01000000:3.0:1789120866.666403:0:13431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffd871d94e0 - data ffff9ffd8fe83438/ffff9ffdbfba5400 00000020:01000000:3.0:1789120866.666532:0:13431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffd86592600 - data ffff9ffd8fc6bca8/ffff9ffd9d34fc00 00000001:00000004:3.0:1789120866.672627:0:13431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1789120866.738129:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789120866.738137:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789120866.738660:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789120866.738664:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789120866.739022:0:6737:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789120866.739027:0:6737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789120866.739037:0:6737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789120866.740427:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789120866.740433:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789120866.740453:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789120866.740455:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789120866.740748:0:7862:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789120866.740753:0:7862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789120866.740763:0:7862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789120866.817680:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a7c 00000020:00000080:1.0:1789120866.817702:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aa8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789120866.818034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aa8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789120866.819368:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a91 00000020:00000080:1.0:1789120866.819378:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aad000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789120866.819574:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789120866.819582:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789120866.819590:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789120866.819594:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ffdb9aa0000) has no exports 00000004:01000000:1.0:1789120866.819814:0:13431:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789120866.819822:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4ccf 00000020:00000080:1.0:1789120866.819827:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffc83f25000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789120866.822547:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789120866.827927:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789120866.829227:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc83f25000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789120866.833817:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.833834:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789120866.833839:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ffc812cced8) has no exports 00000020:00000080:0.0:1789120866.833849:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4cc8 00000020:00000080:0.0:1789120866.833859:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb590b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789120866.834299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb590b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789120866.834679:0:13431:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789120866.834683:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789120866.834748:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789120866.834755:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789120866.834757:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789120866.834847:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.834856:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789120866.834865:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4be8 00000020:00000080:0.0:1789120866.834882:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffc81841000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789120866.834984:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffda0b5e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789120866.834993:0:37:0:(genops.c:885:class_export_put()) final put ffff9ffdb590d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789120866.834996:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb590d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789120866.835006:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789120866.837530:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789120866.837543:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.837554:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789120866.837558:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ffd955d4ed8) has no exports 00000020:00000080:0.0:1789120866.837567:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4be1 00000020:00000080:0.0:1789120866.837574:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb48b6000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789120866.838090:0:13431:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789120866.838095:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789120866.838098:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789120866.838103:0:13431:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789120866.838105:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789120866.838135:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.838157:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789120866.838242:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.838246:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789120866.838249:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffd82c4c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789120866.838253:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd82c4c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789120866.838263:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789120866.838400:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a98 00000020:00000080:0.0:1789120866.838405:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aa8000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789120866.838408:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789120866.838411:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.838415:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789120866.838417:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ffdb9aa3490) has no exports 00000020:00000080:0.0:1789120866.838433:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.838435:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789120866.838438:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a9f 00000020:00000080:0.0:1789120866.838441:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aae800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789120866.838447:0:13431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffd85287800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789120866.838450:0:13431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffd85287800 3 00000020:01000004:0.0:1789120866.838452:0:13431:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffd85287800 from lustre-MDT0000 00000020:00000080:0.0:1789120866.838475:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.838477:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789120866.838480:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aa9800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789120866.838482:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aa9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789120866.838488:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789120866.838510:0:13431:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789120866.838512:0:13431:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789120866.838515:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789120866.838517:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.838519:0:13431:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789120866.838524:0:13431:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ffda0805800 71bf207b-8b16-4d55-83e2-f8c047f616c0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789120866.838529:0:13431:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ffd955d0000) has exports, disconnecting them 00000020:00080000:0.0:1789120866.838533:0:13431:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ffda0805800), last request at 1789120651 00000020:00000080:0.0:1789120866.838545:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a3d 00000020:00010000:0.0:1789120866.838548:0:13431:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ffda0805800: total 4 00000100:00080000:0.0:1789120866.838551:0:13431:0:(import.c:65:import_set_state_nolock()) ffff9ffd84e5b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789120866.838566:0:13431:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffda0805800): rc 0 00000020:00080000:0.0:1789120866.838569:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ffd955d0000) has no exports 00000020:00010000:0.0:1789120866.838587:0:12067:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ffda0805800: total 4 00010000:00010000:0.0:1789120866.838603:0:12067:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ffda0805800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789120866.838626:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390b200/0x13cfa3d77faa4d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d38 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120866.838639:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390be00/0x13cfa3d77faa4d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d46 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120866.838662:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691200/0x13cfa3d77faa4d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d54 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120866.838672:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa4d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d62 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120866.838693:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390b000/0x13cfa3d77faa4fc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4fbc expref: 5 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120866.838705:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390a200/0x13cfa3d77faa4fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4fca expref: 4 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789120866.838715:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc81841000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:00010000:0.0:1789120866.838721:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd8390ba00/0x13cfa3d77faa4b55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4b4e expref: 3 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789120866.838728:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb48b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789120866.838735:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb48b2000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789120866.838741:0:37:0:(genops.c:885:class_export_put()) final put ffff9ffc81847800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789120866.838744:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690a00/0x13cfa3d77faa4d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x13cfa3d77faa4d8c expref: 2 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789120866.838745:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc81847800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789120866.838752:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789120866.838838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aa8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789120866.838843:0:37:0:(genops.c:885:class_export_put()) final put ffff9ffdb9aaf000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789120866.838845:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aaf000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789120866.838848:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789120866.838979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb9aae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789120866.839018:0:12067:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ffda0805800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789120866.839032:0:12067:0:(genops.c:885:class_export_put()) final put ffff9ffda0805800/71bf207b-8b16-4d55-83e2-f8c047f616c0 00010000:00010000:0.0:1789120866.839050:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120866.839052:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120866.839054:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120866.839108:0:5851:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ffda02ff600:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1789120866.839110:0:5850:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ffd8fa9aa00:5850] 0 exiting: rc = 1 00000020:00000080:3.0:1789120866.839215:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffda0805800/71bf207b-8b16-4d55-83e2-f8c047f616c0 for MGS 00000100:00100000:0.0:1789120866.839270:0:5852:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ffda02fe000:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1789120866.839318:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789120866.839339:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd84e5b800 for MGS 00000100:00100000:0.0:1789120866.839394:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839403:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839415:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839421:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839426:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839431:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839436:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839441:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839446:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839451:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839462:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839467:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839471:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839476:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839481:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839486:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839491:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839497:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839501:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839506:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839511:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839516:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839520:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839525:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839530:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839535:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839539:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839544:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839549:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839554:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839558:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839563:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839567:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839572:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839577:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839581:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839586:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839591:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839596:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839600:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839605:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839610:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839614:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839618:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839623:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839632:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839637:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839658:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839666:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839671:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839676:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839681:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839686:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839691:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839695:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839700:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839705:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839710:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839714:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839719:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839723:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839727:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.839847:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789120866.840643:0:13431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789120866.840657:0:13431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789120866.843122:0:13431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffd90646300 - data ffff9ffd8fe4d510/ffff9ffdb9520800 00000020:01000000:1.0:1789120866.843384:0:13431:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffda0cd4d20 - data ffff9ffd9df3c6c0/ffff9ffd82f7d800 00000020:00000080:1.0:1789120866.843844:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a21 00000020:00000080:1.0:1789120866.843852:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdaa06c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789120866.844022:0:13431:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffd85287800 from MGS, refs=2 00000020:01000004:1.0:1789120866.844026:0:13431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffd85287800 2 00000020:01000004:1.0:1789120866.844029:0:13431:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffd85287800 from MGS 00000020:00000080:1.0:1789120866.844051:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789120866.844057:0:13431:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789120866.844070:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdaa06c000/MGS 00000020:00000080:1.0:1789120866.844073:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdaa06c000/MGS for MGS 00000020:01000000:1.0:1789120866.844081:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789120866.844137:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789120866.844173:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789120866.844179:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789120866.844185:0:13431:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ffdb48b1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789120866.844190:0:13431:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ffd8fb81a48) has exports, disconnecting them 00000020:00080000:1.0:1789120866.844194:0:13431:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ffdb48b1000), last request at 1789120652 00000020:00000080:1.0:1789120866.844640:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4aec 00000020:00080000:1.0:1789120866.844665:0:13431:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffdb48b1000): rc 0 00000020:00000080:1.0:1789120866.844670:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdb48b1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789120866.845114:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdaa06c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789120866.846209:0:13431:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789120866.846215:0:13431:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789120866.846219:0:13431:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789120866.846225:0:13431:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789120866.846322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb48b1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789120866.846541:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.846553:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789120866.846561:0:13431:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffd85287800 1 00000020:00000080:0.0:1789120866.846726:0:13431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a13 00000020:00000080:0.0:1789120866.846733:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffdaa068800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789120866.846738:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789120866.846742:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.846746:0:13431:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789120866.846749:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ffd8fb80000) has no exports 00000020:00000080:3.0:1789120866.846813:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb48b1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789120866.846821:0:37:0:(genops.c:885:class_export_put()) final put ffff9ffdafde3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789120866.846824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdafde3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789120866.846833:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789120866.846896:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdaa068800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789120866.927936:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.927949:0:13431:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789120866.927954:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffd9d1cf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789120866.927968:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd9d1cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789120866.927976:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789120866.930394:0:13431:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffd83eae800 00000020:01000000:0.0:1789120866.930423:0:13431:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789120866.930428:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120866.930433:0:13431:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789120866.930437:0:13431:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ffd9cd19a48) has no exports 00000100:00100000:3.0:1789120866.930701:0:5859:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ffd9577d400:5859] 2 exiting: rc = 0 00000100:00100000:3.0:1789120866.933358:0:5857:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ffd9577de00:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1789120866.933454:0:8217:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ffdb54cde00:8217] 3 exiting: rc = 0 00000100:00100000:3.0:1789120866.933515:0:5858:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ffd95478600:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1789120866.936709:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.936719:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.936724:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937001:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937006:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937011:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937016:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937021:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937026:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937031:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937036:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937041:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937045:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937050:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937060:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937064:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937069:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937083:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937096:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937101:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937105:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937111:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937115:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937120:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937126:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937131:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937136:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937183:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937190:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937206:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937212:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937217:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937223:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937227:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937233:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937238:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937243:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937247:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937253:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937258:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937264:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937269:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937275:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937280:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937285:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937290:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937295:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937300:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937305:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937311:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937316:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937322:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937327:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937332:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937338:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937345:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937350:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937355:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937360:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937366:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937371:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937377:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937391:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.937396:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.944700:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ffd9577d200:5861] 1 exiting: rc = 0 00000100:00100000:0.0:1789120866.946269:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ffd9577d000:5860] 0 exiting: rc = 1 00000100:00100000:3.0:1789120866.946352:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946374:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946381:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946387:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946393:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946398:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946404:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946409:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946416:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946421:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946426:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946461:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946474:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946480:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946486:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946491:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946496:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946501:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946506:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946512:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946520:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946526:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946531:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946536:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946541:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946547:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946552:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946557:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946562:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946568:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946573:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946578:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946584:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946588:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946593:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946598:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946611:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946617:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946623:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946628:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946633:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946790:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946800:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946806:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946811:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946817:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946822:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946827:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946832:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946837:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946843:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946847:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946852:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946857:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946862:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946867:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946873:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946878:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946883:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946888:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946892:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946896:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946901:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.946905:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.947515:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ffd9577da00:5862] 0 exiting: rc = 1 00000100:00100000:2.0:1789120866.949113:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ffd9577ca00:5863] 1 exiting: rc = 0 00000100:00100000:2.0:1789120866.949257:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949264:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949275:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949281:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949288:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949296:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949302:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949308:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949314:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949319:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949325:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949331:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949352:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949359:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949439:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949447:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949456:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949465:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949475:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949485:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949494:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949504:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949515:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949525:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949549:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949557:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949562:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949567:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949575:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949581:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949587:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949595:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949602:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949611:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949624:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949642:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949688:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949700:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949708:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949715:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949724:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949733:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949739:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949749:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949757:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949762:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949768:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949774:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949791:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949798:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949807:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949814:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949821:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949830:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949840:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949850:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949862:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949873:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949885:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.949906:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.950032:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.950039:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.950044:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120866.950051:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.957666:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ffd9cda9400:5865] 1 exiting: rc = 0 00000100:00100000:0.0:1789120866.958077:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ffd9cdb2e00:5864] 0 exiting: rc = 1 00000100:00100000:3.0:1789120866.958185:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958272:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958282:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958290:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958298:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958306:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958312:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958335:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958341:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958346:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958359:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958364:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958369:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958374:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958379:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958384:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958390:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958395:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958399:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958405:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958410:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958415:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958420:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958425:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958430:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958434:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958466:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958473:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958478:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958483:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958488:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958494:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958499:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958504:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958509:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958514:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958518:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958522:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958527:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.958532:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959085:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959097:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959113:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959121:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959127:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.959134:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960404:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960417:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960422:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960427:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960432:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960552:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960560:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960567:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960575:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960582:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960590:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960597:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960608:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960616:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960623:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960967:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960973:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120866.960978:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962314:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ffd9577f600:5867] 1 exiting: rc = 0 00000100:00100000:2.0:1789120866.962564:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ffd9cdb2a00:5866] 0 exiting: rc = 1 00000100:00100000:0.0:1789120866.962632:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962641:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962659:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962667:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962674:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962682:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962689:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962696:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962704:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962712:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962720:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962728:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962735:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962743:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962750:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962759:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962766:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962772:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962779:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962786:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962792:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962798:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962808:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962819:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962829:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962836:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962846:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962854:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962922:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962930:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962935:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962940:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962944:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962949:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962954:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962959:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962963:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962968:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962973:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962983:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962988:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962993:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.962997:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963002:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963007:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963012:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963017:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963022:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963026:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963031:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963040:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963045:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963050:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963055:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963060:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963064:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963069:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963074:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963078:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963082:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963087:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963092:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963101:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120866.963113:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965368:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ffd9577e400:5868] 0 exiting: rc = 1 00000100:00100000:1.0:1789120866.965465:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ffd9577e600:5869] 1 exiting: rc = 0 00000100:00100000:1.0:1789120866.965517:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965523:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965534:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965540:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965546:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965551:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965556:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965561:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965566:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965571:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965576:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965581:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965588:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965593:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965599:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965604:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965609:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965624:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965629:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965634:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965639:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965644:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965660:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965665:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965671:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965676:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965681:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965687:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965692:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965697:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965702:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965708:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965714:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965720:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965725:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965730:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965735:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965741:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965747:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965752:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965758:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965763:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965768:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965773:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965779:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965784:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965789:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965795:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965800:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965805:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965811:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965816:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965829:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965834:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965839:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965844:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965848:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965853:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965858:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965862:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965866:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965871:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965876:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.965881:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.966565:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ffd88e34800:5871] 1 exiting: rc = 0 00000100:00100000:1.0:1789120866.966812:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ffdb4869800:5872] 2 exiting: rc = 0 00000100:00100000:1.0:1789120866.969544:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ffd8fa9b600:5870] 0 exiting: rc = 1 00000100:00100000:1.0:1789120866.969677:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969683:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969691:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969696:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969702:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969707:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969712:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969718:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969723:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969729:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969734:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969739:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969744:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969748:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969754:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.969759:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970060:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970182:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970189:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970462:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970483:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970490:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970495:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970500:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970505:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970511:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970517:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970521:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970527:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970533:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970538:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970544:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970549:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970554:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970560:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970565:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970570:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970574:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970580:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970591:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970613:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970690:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970696:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970701:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970707:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970713:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970719:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970724:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970730:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970735:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970741:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970746:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970751:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970756:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970762:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970776:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970781:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970786:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970791:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970797:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970803:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970810:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970815:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120866.970820:0:13431:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789120866.978912:0:13431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120866.978924:0:13431:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789120866.978929:0:13431:0:(genops.c:885:class_export_put()) final put ffff9ffd95582800/MDS_uuid 00000020:00000080:0.0:1789120866.978934:0:13431:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd95582800/MDS_uuid for MDS 00000020:01000000:0.0:1789120866.978944:0:13431:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789120866.979082:0:13431:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789120867.562398:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120868.074961:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120868.074981:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922353152:0@lo:400:kworker.0 00000400:00000100:3.0:1789120868.075030:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922353152 offset 0 length 224: 4 00000100:00100000:0.0:1789120868.075271:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922353024:0@lo:400:kworker.0 00000400:00000100:0.0:1789120868.075297:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922353024 offset 0 length 224: 4 00000100:00100000:0.0:1789120868.075315:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120868.075320:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922352896:0@lo:400:kworker.0 00000400:00000100:0.0:1789120868.075336:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028922352896 offset 0 length 224: 4 00010000:00010000:2.0:1789120868.587548:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120869.613613:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789120869.919376:0:13587:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789120869.934410:0:13587:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789120869.934455:0:13587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120869.934470:0:13587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120869.934478:0:13587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120869.934485:0:13587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120869.934505:0:13587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789120869.934509:0:13587:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789120869.934533:0:13587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789120869.934544:0:13587:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffdb598fc00 x1876028922353024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120869.934556:0:13587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789120869.934561:0:13587:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789120869.934597:0:13587:0:(import.c:65:import_set_state_nolock()) ffff9ffc81847000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789120869.934684:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922353280:0@lo:39:umount.0 00000100:00100000:0.0:1789120869.934702:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922353024:0@lo:400:kworker.0 00000400:00000100:3.0:1789120869.934729:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922353280 offset 0 length 224: 4 00010000:00010000:2.0:1789120869.935127:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120869.935136:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120869.935249:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4ac00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120869.935254:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120869.935263:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120869.935270:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120869.935275:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789120869.935278:0:5846:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789120869.935280:0:5846:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789120869.935308:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120869.935315:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789120869.936191:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922353408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120869.936249:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120869.936492:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922353408 00000100:00100000:1.0:1789120869.936509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922353408 00000100:00100000:1.0:1789120869.936560:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789120869.936567:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3318:x1876028922353408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789120869.936574:0:5842:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789120869 with bad export cookie 1427539752854899261 00010000:00010000:2.0:1789120869.937193:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120869.937204:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ac00/0x13cfa3d77faa4d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x13cfa3d77faa4d5b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120869.937219:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120869.937221:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120869.937223:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120869.955338:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3318:x1876028922353408:12345-0@lo:103:ldlm_bl.0 Request processed in 18763us (19082us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789120869.955351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789120869.958862:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789120869.958870:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9ffd95580000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789120869.958875:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789120869.981685:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.109@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789120869.981691:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789120869.981700:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffdb598c000 x1876028922352896/t0(0) o400->MGC192.168.206.109@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789120884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120869.981798:0:3318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc83461680 x1876028922353408/t0(0) o103->MGC192.168.206.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789120869.981808:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789120869.981810:0:3318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789120869.981831:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789120869.981834:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9ffd95580000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789120869.981839:0:3318:0:(import.c:510:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 118 00000100:00080000:0.0:1789120869.981848:0:3318:0:(import.c:624:import_select_connection()) MGC192.168.206.109@tcp: import ffff9ffd95580000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789120869.981877:0:3318:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb98e8f00 x1876028922353536/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120869.981914:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71bf207b-8b16-4d55-83e2-f8c047f616c0:3318:1876028922353408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120869.982395:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71bf207b-8b16-4d55-83e2-f8c047f616c0:3320:1876028922352896:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.982434:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922353536:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1789120869.982482:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028922353536 offset 0 length 520: 4 00010000:00010000:2.0:1789120870.634370:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120871.660169:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120872.682365:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789120873.194986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789120873.194997:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789120873.195197:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120873.195218:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc834621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922353664:0@lo:400:kworker.0 00000400:00000100:3.0:1789120873.195282:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922353664 offset 0 length 224: 4 00010000:00010000:2.0:1789120873.706770:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120874.731096:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789120875.243462:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789120875.243476:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789120875.243750:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120875.243779:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922353792:0@lo:400:kworker.0 00000400:00000100:0.0:1789120875.243852:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922353792 offset 0 length 224: 4 00010000:00010000:1.0:1789120875.755724:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120876.778353:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120877.804264:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120878.826612:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120879.343629:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120869/real 1789120869] req@ffff9ffdb98e8f00 x1876028922353536/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789120879 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120879.343674:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb98e8f00 x1876028922353536/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789120879 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120879.343686:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120869/real 1789120869] req@ffff9ffdb598f480 x1876028922353280/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789120879 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120879.343698:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb598f480 x1876028922353280/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789120879 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789120879.343717:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd95580000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789120879.343750:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789120879.343754:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922353536:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789120879.343761:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffc81847000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789120879.343778:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922353280:0@lo:39:umount.0 00000100:00080000:1.0:1789120879.345366:0:13587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789120879.345378:0:13587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789120879.345387:0:13587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789120879.346341:0:13587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346358:0:13587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346367:0:13587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346374:0:13587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346400:0:13587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120879.346409:0:13587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346437:0:13587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346443:0:13587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346449:0:13587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120879.346489:0:13587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789120879.346494:0:13587:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789120879.346524:0:13587:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789120879.346529:0:13587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789120879.346535:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789120879.346541:0:13587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789120879.346547:0:13587:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ffd955d1a48) has no exports 00000020:00080000:1.0:1789120879.346799:0:13587:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ffd955d1a48) has no exports 00010000:00010000:2.0:1789120879.348271:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120879.348286:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348299:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120879.348304:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348315:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120879.348323:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120879.348330:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789120879.348333:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789120879.348337:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789120879.348363:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:2.0:1789120879.348368:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348375:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd81691800/0x13cfa3d77faa4d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348416:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120879.348421:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348427:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5000 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120879.348430:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348437:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120879.348444:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120879.348449:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789120879.348452:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789120879.348454:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789120879.348460:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:2.0:1789120879.348463:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348469:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa5000/0x13cfa3d77faa4fca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4fd1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120879.348477:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120879.348479:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120879.348481:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120879.348782:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789120879.348864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789120879.348870:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789120879.348874:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ffd95580000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120879.348884:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 337 00000100:00080000:3.0:1789120879.348890:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.109@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789120879.348896:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.109@tcp: import ffff9ffd95580000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120879.348938:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dfc00 x1876028922353920/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120879.349029:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120879.349048:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922354048:0@lo:400:kworker.0 00000400:00000100:3.0:1789120879.349116:0:3318:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922354048 offset 0 length 224: 4 00000100:00100000:0.0:1789120879.349270:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922353920:0@lo:250:kworker.0 00000400:00000100:0.0:1789120879.349296:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028922353920 offset 0 length 520: 4 00000020:01000000:1.0:1789120879.356592:0:13587:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffdafefa8a0 - data ffff9ffd9dfc0948/ffff9ffdb98d7800 00000020:01000000:1.0:1789120879.356745:0:13587:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffdafb8e1e0 - data ffff9ffd8fedcaf8/ffff9ffc8182b800 00100000:10000000:1.0:1789120879.367735:0:13587:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789120879.430389:0:13587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4b71 00000020:00000080:0.0:1789120879.430402:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb5f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789120879.430425:0:13587:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffdaf537000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789120879.430430:0:13587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdaf537000 2 00000020:01000004:0.0:1789120879.430434:0:13587:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffdaf537000 from lustre-OST0000 00000020:00000080:0.0:1789120879.430463:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789120879.430472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb5f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789120879.430475:0:13587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789120879.430478:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb5f800/lustre-OST0000_UUID 00000020:00000080:0.0:1789120879.430480:0:13587:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb5f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789120879.430487:0:13587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789120879.430550:0:13587:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789120879.430555:0:13587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789120879.430560:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120879.430566:0:13587:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789120879.430574:0:13587:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ffc81845000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789120879.430590:0:13587:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9ffd955d3490) has exports, disconnecting them 00000020:00080000:0.0:1789120879.430595:0:13587:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ffc81845000), last request at 1789120666 00000020:00000080:0.0:1789120879.430599:0:13587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4b9b 00000020:00080000:0.0:1789120879.430613:0:13587:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffc81845000): rc 0 00000020:00000080:0.0:1789120879.430620:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffc81845000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789120879.430661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc81845000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789120879.432433:0:13587:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789120879.432443:0:13587:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789120879.432449:0:13587:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789120879.432457:0:13587:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789120879.432529:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffc81847000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789120879.432653:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120879.432662:0:13587:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789120879.432669:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb5b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789120879.432685:0:13587:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb5b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789120879.432692:0:13587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789120879.432759:0:13587:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdaf537000 1 00000020:00000080:0.0:1789120879.432765:0:13587:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4b2b 00000020:00000080:0.0:1789120879.432772:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffd90ad1800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789120879.432787:0:13587:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789120879.432791:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120879.432800:0:13587:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789120879.432804:0:13587:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ffd8fb83490) has no exports 00000020:00000080:3.0:1789120879.432837:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd90ad1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789120879.443858:0:13587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789120879.443878:0:13587:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789120879.443885:0:13587:0:(genops.c:885:class_export_put()) final put ffff9ffd90ad7000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789120879.443891:0:13587:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd90ad7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789120879.443899:0:13587:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789120879.444076:0:13587:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffdaf534800 00000020:02000400:1.0:1789120879.444133:0:13587:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789120879.850449:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120880.874291:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789120881.809789:0:13740:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789120881.819298:0:13740:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789120881.819395:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120881.819413:0:13740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120881.819421:0:13740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120881.819429:0:13740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120881.819459:0:13740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789120881.819466:0:13740:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789120881.819495:0:13740:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789120881.819509:0:13740:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffdb598cb40 x1876028922353152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120881.819540:0:13740:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc834621c0 x1876028922353664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120889 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120881.819558:0:13740:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffc83460000 x1876028922353792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120891 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120881.819606:0:13740:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffdb54dd2c0 x1876028922354048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120895 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120881.819616:0:13740:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789120881.819654:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922353792:0@lo:400:kworker.0 00000100:00100000:2.0:1789120881.819683:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc834621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876028922353664:0@lo:400:kworker.0 00000100:00080000:0.0:1789120881.819688:0:13740:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789120881.819694:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120881.819705:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120881.819715:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4a800 already unused, calling callback (ffffffffc1ab9c20) 00000100:00080000:0.0:1789120881.819718:0:13740:0:(import.c:65:import_set_state_nolock()) ffff9ffdb590b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1789120881.819720:0:12067:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120881.819733:0:12067:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120881.819750:0:12067:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120881.819756:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922354176:0@lo:39:umount.0 10000000:01000000:3.0:1789120881.819758:0:12067:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789120881.819765:0:12067:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789120881.819768:0:12067:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789120881.819786:0:12067:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:3.0:1789120881.819791:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120881.819798:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa4d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d3f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120881.819811:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120881.819814:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120881.819816:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1789120881.819820:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028922354176 offset 0 length 224: 4 00000100:00100000:1.0:1789120881.819934:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922354048:0@lo:400:kworker.0 00000100:00100000:1.0:1789120881.819956:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922353152:0@lo:400:kworker.0 00010000:00010000:3.0:1789120881.899689:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120882.922423:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120883.946394:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789120884.458377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789120884.458387:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789120884.970441:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120885.994290:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120887.018579:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120888.042455:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120889.066677:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120889.582478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789120889.582489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789120890.090445:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120891.115689:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120892.010280:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120881/real 1789120881] req@ffff9ffdb98ea940 x1876028922354176/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789120891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120892.010311:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb98ea940 x1876028922354176/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789120891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789120892.010329:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdb590b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789120892.010353:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922354176:0@lo:39:umount.0 00000100:00080000:3.0:1789120892.010584:0:13740:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789120892.010589:0:13740:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789120892.010594:0:13740:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789120892.012267:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012286:0:13740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012309:0:13740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012317:0:13740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012420:0:13740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789120892.012431:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012438:0:13740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012444:0:13740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.012451:0:13740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120892.014364:0:13740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789120892.014379:0:13740:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789120892.014426:0:13740:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789120892.014431:0:13740:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789120892.014440:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789120892.014445:0:13740:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789120892.014449:0:13740:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ffd9cd1ced8) has no exports 00000020:00080000:3.0:1789120892.014973:0:13740:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ffd9cd1ced8) has no exports 00010000:00010000:2.0:1789120892.016499:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:3.0:1789120892.025567:0:13740:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffdafefa780 - data ffff9ffd8fee5360/ffff9ffdb98d4c00 00000020:01000000:3.0:1789120892.025825:0:13740:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9ffda0d21a80 - data ffff9ffd8fe97a20/ffff9ffdb54f7000 00010000:00010000:0.0:1789120892.026170:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120892.026180:0:12067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120892.026191:0:12067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4600 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120892.026195:0:12067:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120892.026215:0:12067:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120892.026223:0:12067:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120892.026229:0:12067:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789120892.026232:0:12067:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789120892.026235:0:12067:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789120892.026249:0:12067:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:0.0:1789120892.026253:0:12067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120892.026259:0:12067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb5fa4600/0x13cfa3d77faa4fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4fc3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120892.026274:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120892.026276:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120892.026278:0:12067:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120892.026525:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120892.026533:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4ba00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120892.026536:0:5845:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120892.026542:0:5845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120892.026548:0:5845:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120892.026554:0:5845:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789120892.026556:0:5845:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789120892.026558:0:5845:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789120892.026565:0:5845:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:2.0:1789120892.026569:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120892.026575:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa4d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d4d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120892.026584:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120892.026586:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120892.026587:0:5845:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789120892.053050:0:13740:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789120892.120642:0:13740:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4c3c 00000020:00000080:0.0:1789120892.120653:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffda0a4a800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789120892.120712:0:13740:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffdbfb5a800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789120892.120715:0:13740:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdbfb5a800 2 00000020:01000004:0.0:1789120892.120718:0:13740:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ffdbfb5a800 from lustre-OST0001 00000020:00000080:0.0:1789120892.120754:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120892.120763:0:13740:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789120892.120766:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb5e800/lustre-OST0001_UUID 00000020:00000080:0.0:1789120892.120769:0:13740:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb5e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789120892.120775:0:13740:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789120892.120950:0:13740:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 71bf207b-8b16-4d55-83e2-f8c047f616c0->MGS 00010000:00010000:0.0:1789120892.120976:0:13740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120892.120991:0:13740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120892.120997:0:13740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789120892.121000:0:13740:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789120892.121004:0:13740:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789120892.121020:0:13740:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:0.0:1789120892.121023:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8148b200/0x13cfa3d77faa4b4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4b55 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120892.121038:0:13740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120892.121045:0:13740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120892.121050:0:13740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789120892.121052:0:13740:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789120892.121053:0:13740:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789120892.121075:0:13740:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ffd95580000 00010000:00010000:0.0:1789120892.121078:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8390a000/0x13cfa3d77faa4d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x13cfa3d77faa4d93 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789120892.121094:0:13740:0:(import.c:65:import_set_state_nolock()) ffff9ffd95580000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789120892.121098:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789120892.121100:0:13740:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789120892.121102:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789120892.121106:0:13740:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789120892.121116:0:13740:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ffdb54dfc00 x1876028922353920/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789120894 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789120892.121232:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789120892.121236:0:13740:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789120892.121364:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71bf207b-8b16-4d55-83e2-f8c047f616c0:3316:1876028922353920:0@lo:250:kworker.0 10000000:01000000:0.0:1789120892.121426:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789120892.121433:0:13740:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4a2f 00000020:00000080:0.0:1789120892.121437:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffd95586800/71bf207b-8b16-4d55-83e2-f8c047f616c0 00000020:00000080:1.0:1789120892.121503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffda0a4a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789120892.126191:0:13740:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.109@tcp (flags='') 00000020:00000080:0.0:1789120892.126205:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120892.126213:0:13740:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789120892.126219:0:13740:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ffd9cd18000) has no exports 10000000:01000000:3.0:1789120892.126271:0:5854:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789120892.126284:0:13740:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.109@tcp: client import never connected 00000100:00080000:0.0:1789120892.126290:0:13740:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789120892.126294:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789120892.126298:0:13740:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789120892.126300:0:13740:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789120892.126346:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120892.126354:0:13740:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.109@tcp (uuid 71bf207b-8b16-4d55-83e2-f8c047f616c0) 00000020:01000000:0.0:1789120892.126359:0:13740:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789120892.126363:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120892.126493:0:13740:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789120892.126499:0:13740:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ffdb590a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789120892.126505:0:13740:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9ffc812cb490) has exports, disconnecting them 00000020:00080000:0.0:1789120892.126519:0:13740:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ffdb590a800), last request at 1789120682 00000020:00000080:0.0:1789120892.126524:0:13740:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4c66 00000020:00080000:0.0:1789120892.126539:0:13740:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ffdb590a800): rc 0 00000020:00000080:0.0:1789120892.126543:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffdb590a800/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789120892.127108:0:13740:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789120892.127112:0:13740:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789120892.127115:0:13740:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789120892.127120:0:13740:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789120892.127300:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789120892.127306:0:13740:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789120892.127310:0:13740:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdbfb5a800 1 00000020:00000080:0.0:1789120892.127316:0:13740:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x13cfa3d77faa4c0b 00000020:00000080:0.0:1789120892.127321:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffc81840000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789120892.127325:0:13740:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789120892.127329:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789120892.127331:0:13740:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789120892.127334:0:13740:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ffdb57bced8) has no exports 00000020:00000080:1.0:1789120892.130875:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd95586800/71bf207b-8b16-4d55-83e2-f8c047f616c0 for MGC192.168.206.109@tcp 00000020:00000080:1.0:1789120892.130891:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffd95580000 for MGC192.168.206.109@tcp 00000020:00000080:1.0:1789120892.130898:0:36:0:(genops.c:885:class_export_put()) final put ffff9ffd95583800/71bf207b-8b16-4d55-83e2-f8c047f616c0 00000020:00000080:1.0:1789120892.130901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd95583800/71bf207b-8b16-4d55-83e2-f8c047f616c0 for MGC192.168.206.109@tcp 00000020:01000000:1.0:1789120892.130906:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.109@tcp (71bf207b-8b16-4d55-83e2-f8c047f616c0) 00010000:00010000:3.0:1789120892.132784:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789120892.132855:0:12067:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789120892.133225:0:5845:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789120892.133308:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ffd88e34400:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1789120892.133650:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ffd88e34a00:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1789120892.134133:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.135120:0:5842:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ffd9fe14e00:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1789120892.135170:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ffd9d38dc00:5844] 2 exiting: rc = 0 00000100:00100000:3.0:1789120892.136828:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ffd9fe14400:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1789120892.137380:0:12923:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ffc83ae2200:12923] 3 exiting: rc = 0 00000100:00100000:1.0:1789120892.137451:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137925:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137934:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137944:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137954:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137964:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137974:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137984:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.137994:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.138004:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.138015:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.138027:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.138039:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139039:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139053:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139069:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139088:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139094:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139098:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139103:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139109:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139113:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139119:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139124:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139129:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139137:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139695:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139706:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139711:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139716:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139720:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139726:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139731:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139737:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139742:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139747:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139752:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139757:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139762:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139767:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139773:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139778:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139784:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139788:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139793:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139799:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139805:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139810:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139815:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139820:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139826:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139839:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139845:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139850:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139860:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139866:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139872:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139876:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139882:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139886:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139891:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139895:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139900:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.139906:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789120892.140613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb590a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789120892.140622:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ffdb590b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789120892.140628:0:36:0:(genops.c:885:class_export_put()) final put ffff9ffdb590f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789120892.140631:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdb590f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789120892.140635:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789120892.140666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffc81840000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789120892.152964:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789120892.152980:0:13740:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789120892.152986:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffdbfb5d000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789120892.152990:0:13740:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffdbfb5d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789120892.152997:0:13740:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789120892.153235:0:13740:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ffdbfb58000 00000020:01000000:3.0:1789120892.153254:0:13740:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789120892.153258:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789120892.153262:0:13740:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789120892.153266:0:13740:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ffd8fb84ed8) has no exports 00000020:00000080:3.0:1789120892.153293:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789120892.153300:0:13740:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789120892.153304:0:13740:0:(genops.c:885:class_export_put()) final put ffff9ffd90ad6000/OSS_uuid 00000020:00000080:3.0:1789120892.153307:0:13740:0:(genops.c:844:class_export_destroy()) destroying export ffff9ffd90ad6000/OSS_uuid for OSS 00000020:01000000:3.0:1789120892.153312:0:13740:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789120892.153337:0:5853:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789120892.153972:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ffda0b4a000:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1789120892.154016:0:8216:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ffdb54cc600:8216] 3 exiting: rc = 0 00000100:00100000:3.0:1789120892.154055:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ffda3ae8400:6707] 2 exiting: rc = 0 00000100:00100000:0.0:1789120892.158383:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ffda0b4b600:6705] 0 exiting: rc = 1 00000100:00100000:3.0:1789120892.158545:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158557:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158566:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158576:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158596:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158606:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158616:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158625:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158636:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158645:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158758:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158769:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158778:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158785:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158795:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158804:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158814:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158821:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158827:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158832:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158838:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158844:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158850:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158855:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158863:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158868:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158873:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158877:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158882:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158887:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158891:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158896:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158900:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158909:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158914:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158919:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158923:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158928:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158933:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158943:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158948:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158961:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158967:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158972:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158977:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158982:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158987:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158993:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.158997:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159002:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159007:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159012:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159016:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159020:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159025:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159030:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159034:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159040:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159045:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159050:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159055:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159059:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159064:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.159069:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789120892.160586:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ffda0b4b000:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1789120892.160677:0:12101:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ffd83e9aa00:12101] 2 exiting: rc = 0 00000100:00100000:3.0:1789120892.161280:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ffda0b4bc00:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1789120892.161375:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161386:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161489:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161495:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161500:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161515:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161522:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161528:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161533:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161539:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161545:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161550:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161555:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161560:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161565:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161570:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161575:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161581:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161586:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161591:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161597:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161603:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161608:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161614:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161629:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161634:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161640:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161645:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161651:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161783:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161789:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161794:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161799:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161805:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161810:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161815:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161821:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161826:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161831:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161838:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161843:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161850:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161857:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161864:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161871:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161880:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161886:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161891:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161937:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161944:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161951:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161968:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161979:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161985:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.161990:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162028:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162035:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162042:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162051:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162067:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162073:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162079:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162084:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.162089:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789120892.163816:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ffdb5665600:6712] 2 exiting: rc = 0 00000100:00100000:2.0:1789120892.164039:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ffd9d033000:6710] 0 exiting: rc = 1 00000100:00100000:1.0:1789120892.164651:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ffdb5664a00:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1789120892.164985:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.164993:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.164998:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165003:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165008:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165014:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165019:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165024:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165030:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165036:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165042:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165047:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165053:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165058:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165063:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165068:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165073:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165078:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165085:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165091:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165096:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165102:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165118:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165125:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165131:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165135:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165140:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165183:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165189:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165195:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165211:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165217:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165222:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165227:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165234:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165240:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165245:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165250:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165256:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165261:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165267:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165272:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165278:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165284:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165291:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165297:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165318:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165325:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165330:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165337:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165342:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165347:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165352:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165357:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165362:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165368:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165373:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165378:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165385:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165401:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165407:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165413:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165419:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.165425:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.172688:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ffd9d032600:6713] 0 exiting: rc = 1 00000100:00100000:3.0:1789120892.172906:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ffdb5664000:6714] 1 exiting: rc = 0 00000100:00100000:2.0:1789120892.173009:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173017:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173022:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173027:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173033:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173037:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173042:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173047:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173052:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173056:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173061:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173067:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173072:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173077:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173082:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173088:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173092:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173097:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173102:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173107:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173112:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173116:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173121:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173126:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173131:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173136:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173140:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173915:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173922:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173927:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173933:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173937:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173942:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173957:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173962:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173966:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173970:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173974:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173978:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173983:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173988:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173992:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.173997:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174003:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174009:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174014:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174020:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174024:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174030:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174035:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174039:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174044:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174049:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174054:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174059:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174064:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174069:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174073:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174078:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174084:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174088:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174094:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174098:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.174108:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789120892.175204:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ffdbba8f800:6715] 0 exiting: rc = 1 00000100:00100000:3.0:1789120892.175812:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ffdbba8ec00:6716] 1 exiting: rc = 0 00000100:00100000:2.0:1789120892.175881:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175924:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175930:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175937:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175957:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175983:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175991:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.175997:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176003:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176010:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176016:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176021:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176027:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176033:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176039:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176044:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176050:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176066:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176070:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176077:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176087:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176093:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176101:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176107:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176110:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176114:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176118:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176122:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176126:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176140:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176317:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176324:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176330:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176336:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176341:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176346:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176351:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176355:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176358:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176483:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176489:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176522:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176530:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176536:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176568:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176581:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176588:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176599:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176606:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176637:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176645:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176742:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176751:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176770:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176777:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176783:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176788:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176794:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176799:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176805:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176811:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176826:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176834:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789120892.176849:0:13740:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789120892.184903:0:13740:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789120907.229671:0:14355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789120913.602572:0:14817:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789120913.602576:0:14817:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789120913.602681:0:14817:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ffd82c7a800 00000020:01000004:1.0:1789120913.602696:0:14817:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789120913.602704:0:14817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789120913.602717:0:14817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ffdb9aa4ed8) 00000020:00000080:1.0:1789120913.602729:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789120913.614872:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789120913.616702:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789120913.617040:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 205: rc = 0 00100000:10000000:2.0:1789120913.617259:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789120913.617324:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 205: rc = 0 00100000:10000000:2.0:1789120913.617546:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 205: rc = 0 00100000:10000000:2.0:1789120913.617641:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 205: rc = 0 00100000:10000000:2.0:1789120913.617789:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 205: rc = 0 00100000:10000000:2.0:1789120913.617890:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 205: rc = 0 00100000:10000000:2.0:1789120913.618135:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 207: rc = 0 00100000:10000000:2.0:1789120913.619199:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 602: rc = 0 00100000:10000000:2.0:1789120913.619302:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 602: rc = 0 00100000:10000000:2.0:1789120913.619696:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:2.0:1789120913.620027:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.620361:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.620626:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1789120913.620875:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.621117:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:2.0:1789120913.621559:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1789120913.621808:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:2.0:1789120913.622060:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.622327:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.622604:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1789120913.622837:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1789120913.623306:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 655: rc = 0 00100000:10000000:2.0:1789120913.623580:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 655: rc = 0 00100000:10000000:2.0:1789120913.623834:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 655: rc = 0 00100000:10000000:2.0:1789120913.624078:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 655: rc = 0 00100000:10000000:2.0:1789120913.624337:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 655: rc = 0 00100000:10000000:2.0:1789120913.624603:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 655: rc = 0 00100000:10000000:2.0:1789120913.624831:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 655: rc = 0 00100000:10000000:2.0:1789120913.625060:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 655: rc = 0 00100000:10000000:2.0:1789120913.625508:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 655: rc = 0 00100000:10000000:2.0:1789120913.625769:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 655: rc = 0 00100000:10000000:2.0:1789120913.626026:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 655: rc = 0 00100000:10000000:2.0:1789120913.626366:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 655: rc = 0 00100000:10000000:2.0:1789120913.626627:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 655: rc = 0 00100000:10000000:2.0:1789120913.626880:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 655: rc = 0 00100000:10000000:2.0:1789120913.627115:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 655: rc = 0 00100000:10000000:2.0:1789120913.627446:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 655: rc = 0 00100000:10000000:2.0:1789120913.627692:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 655: rc = 0 00100000:10000000:2.0:1789120913.627956:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 655: rc = 0 00100000:10000000:2.0:1789120913.628426:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 655: rc = 0 00100000:10000000:2.0:1789120913.628658:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 655: rc = 0 00100000:10000000:2.0:1789120913.628904:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 655: rc = 0 00100000:10000000:2.0:1789120913.629339:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 655: rc = 0 00100000:10000000:2.0:1789120913.629609:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 655: rc = 0 00100000:10000000:2.0:1789120913.629857:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 655: rc = 0 00100000:10000000:2.0:1789120913.630257:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 655: rc = 0 00100000:10000000:2.0:1789120913.630723:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 655: rc = 0 00100000:10000000:2.0:1789120913.630974:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 655: rc = 0 00100000:10000000:2.0:1789120913.631292:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 655: rc = 0 00100000:10000000:2.0:1789120913.631926:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 655: rc = 0 00100000:10000000:2.0:1789120913.632211:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 655: rc = 0 00100000:10000000:2.0:1789120913.632593:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 655: rc = 0 00100000:10000000:2.0:1789120913.632846:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 655: rc = 0 00100000:10000000:2.0:1789120913.633383:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 784: rc = 0 00100000:10000000:2.0:1789120913.633995:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789120913.634191:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 603: rc = 0 00100000:10000000:2.0:1789120913.634375:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789120913.634459:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 603: rc = 0 00100000:10000000:2.0:1789120913.634647:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789120913.634716:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 603: rc = 0 00100000:10000000:2.0:1789120913.635043:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789120913.635111:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 391: rc = 0 00100000:10000000:2.0:1789120913.635317:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789120913.635399:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 391: rc = 0 00100000:10000000:2.0:1789120913.635580:0:14817:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789120913.635648:0:14817:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 391: rc = 0 00000020:00000080:2.0:1789120913.635904:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789120913.635912:0:14817:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789120913.635923:0:14817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5d76 00000020:01000004:2.0:1789120913.635931:0:14817:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789120913.635937:0:14817:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789120913.635943:0:14817:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffd82c7a800 from MGS 00000020:01000004:2.0:1789120913.635946:0:14817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789120913.635957:0:14817:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ffc812c8000) 00000020:00000080:2.0:1789120913.635968:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789120913.636028:0:14817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffd82c7a800 from MGS, refs=2 00080000:01000000:2.0:1789120913.636032:0:14817:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789120913.636037:0:14817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5d84 00000100:00100000:2.0:1789120913.636126:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789120913.636362:0:14817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789120913.636368:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789120913.636847:0:14817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789120913.636853:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789120913.637696:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.637849:0:14817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789120913.637855:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789120913.638472:0:14817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789120913.638479:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789120913.638888:0:14817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789120913.638895:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789120913.639638:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.639642:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.639643:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.639981:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.639983:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.639985:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120913.640535:0:14817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789120913.645278:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789120913.649561:0:14817:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789120913.649577:0:14817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789120913.649580:0:14817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789120913.654762:0:14826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789120913.654967:0:14817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789120913.655073:0:14817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789120913.655610:0:14817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789120913.655904:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.656062:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789120913.656069:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789120913.659027:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789120913.659037:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789120913.659411:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789120913.659417:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789120913.659924:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789120913.659942:0:14817:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.109@tcp' 00000020:01000004:3.0:1789120913.659944:0:14817:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789120913.659971:0:14817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.109@tcp (typ=mgc) 00000020:00000080:3.0:1789120913.659983:0:14817:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.109@tcp (ffff9ffdb57bced8) 00000020:00000080:3.0:1789120913.659997:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789120913.660068:0:14817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffd9544e800@MGC192.168.206.109@tcp: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789120913.660236:0:14817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.109@tcp-0 is initialized 00000040:01000000:3.0:1789120913.660241:0:14817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789120913.662010:0:14831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789120913.665250:0:14833:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789120913.665354:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.109@tcp (uuid 663c5952-eef7-4d23-9f6d-c418f8c48dc5) 00000020:00000080:3.0:1789120913.665378:0:14817:0:(genops.c:1385:class_connect()) connect: client 663c5952-eef7-4d23-9f6d-c418f8c48dc5, cookie 0x13cfa3d77faa5d92 00000100:00080000:3.0:1789120913.665399:0:14817:0:(import.c:510:import_select_connection()) MGC192.168.206.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789120913.665406:0:14817:0:(import.c:624:import_select_connection()) MGC192.168.206.109@tcp: import ffff9ffd9544e800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120913.665437:0:14817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dfc00 x1876028922354304/t0(0) o250->MGC192.168.206.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120913.665498:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3316:1876028922354304:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789120913.665559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.666078:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354304 00000100:00100000:2.0:1789120913.666085:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354304 00000100:00100000:2.0:1789120913.666122:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120913.666130:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1876028922354304:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789120913.666174:0:14828:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 663c5952-eef7-4d23-9f6d-c418f8c48dc5@0@lo t0 exp 0000000000000000 cur 380 last 0 00000020:00000080:2.0:1789120913.666201:0:14828:0:(genops.c:1385:class_connect()) connect: client 663c5952-eef7-4d23-9f6d-c418f8c48dc5, cookie 0x13cfa3d77faa5d99 00000100:00080000:2.0:1789120913.666321:0:14828:0:(import.c:65:import_set_state_nolock()) ffff9ffdb57da000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789120913.666456:0:14817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 663c5952-eef7-4d23-9f6d-c418f8c48dc5->MGS 00000020:01000004:3.0:1789120913.666474:0:14817:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789120913.666479:0:14817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789120913.666491:0:14817:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ffdb57b8000) 00000020:00000080:3.0:1789120913.666510:0:14817:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789120913.672120:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120913.672984:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+5:3316:x1876028922354304:12345-0@lo:250:mount.lustre.0 Request processed in 6847us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.672998:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120913.673291:0:3316:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789120913.673303:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.109@tcp: connect to target with instance 0 00000100:00080000:0.0:1789120913.673312:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789120913.673317:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789120913.673321:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd9544e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789120913.673324:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789120913.673333:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789120913.673338:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3316:1876028922354304:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789120913.675309:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789120913.675317:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789120913.680707:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789120913.680717:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789120913.681119:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120913.681125:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789120913.682085:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.682486:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789120913.682492:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789120913.682931:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789120913.682938:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789120913.735807:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.736008:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789120913.736014:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789120913.737472:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789120913.737484:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789120913.738737:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.738905:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789120913.738911:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789120913.739481:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789120913.739488:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789120913.739958:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120913.740097:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789120913.740101:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789120913.742246:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789120913.742362:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789120913.743782:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120913.744325:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789120913.744332:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789120913.747434:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789120913.747450:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789120913.777813:0:14817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120913.778019:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789120913.778025:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789120913.780503:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789120913.780515:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789120913.785240:0:14817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789120913.785255:0:14817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789120913.788571:0:14817:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789120913.788595:0:14817:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789120913.788600:0:14817:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789120913.788736:0:14817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789120913.788769:0:14817:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789120913.788776:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789120913.788777:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.788779:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.788780:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.788781:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.788782:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.788783:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.788784:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.788786:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.788787:0:14817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120913.788790:0:14817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789120913.788792:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120913.788793:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.788794:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.788795:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.788796:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.788797:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.788797:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.788798:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.788799:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.788800:0:14817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120913.788826:0:14817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789120913.788847:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789120913.788912:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.789012:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d7b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.789093:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354432 00000100:00100000:1.0:1789120913.789100:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354432 00000100:00100000:1.0:1789120913.789268:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120913.789279:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+5:14817:x1876028922354432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789120913.789318:0:14830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789120913.789321:0:14830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789120913.789324:0:14830:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789120913.789593:0:14851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789120913.789877:0:14830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789120913.790694:0:14852:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789120913.790699:0:14852:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789120913.790702:0:14852:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789120913.790736:0:14852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789120913.790987:0:14830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789120913.790997:0:14830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789120913.797239:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+5:14817:x1876028922354432:12345-0@lo:253:mount.lustre.0 Request processed in 7953us (8317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120913.797260:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120913.797484:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789120913.797498:0:14817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789120913.797501:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120913.797503:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.797504:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.797505:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.797506:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.797508:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.797509:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.797510:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.797512:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.797514:0:14817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789120913.797539:0:14817:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffd82c7a800 from lustre-MDT0000 10000000:01000000:0.0:1789120913.797565:0:14817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789120913.797568:0:14817:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789120913.797573:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ffdb57bced8 10000000:01000000:0.0:1789120913.797577:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120913.797583:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ffdb57bced8 from 1 10000000:01000000:0.0:1789120913.797586:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120913.797620:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.797630:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.797638:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.797657:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120913.797692:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.797738:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d7b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.797787:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354560 00000100:00100000:1.0:1789120913.797793:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354560 00000100:00100000:1.0:1789120913.797831:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120913.797840:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+5:14817:x1876028922354560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120913.797853:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120913.797866:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb800/0x13cfa3d77faa5dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5da7 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.797886:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb800/0x13cfa3d77faa5dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5da7 expref: 6 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.797896:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bb800/0x13cfa3d77faa5dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5da7 expref: 6 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.797905:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb800, rc 0) 00000100:00100000:1.0:1789120913.797948:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+6:14817:x1876028922354560:12345-0@lo:101:mount.lustre.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.797954:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120913.798078:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.798091:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798100:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.798171:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.798197:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.798218:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d7b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120913.798280:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354688 00000100:00100000:3.0:1789120913.798284:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354688 00000100:00100000:3.0:1789120913.798309:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120913.798315:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+6:14817:x1876028922354688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789120913.798528:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+6:14817:x1876028922354688:12345-0@lo:501:mount.lustre.0 Request processed in 212us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789120913.798542:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120913.798616:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354688:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789120913.798639:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789120913.798660:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798668:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.798675:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffd82c7a800 10000000:01000000:0.0:1789120913.798678:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789120913.798682:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ffd82c7a800 10000000:01000000:0.0:1789120913.798684:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789120913.798687:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ffd82c7a800 from 1 10000000:01000000:0.0:1789120913.798689:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789120913.798704:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798710:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798717:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.798729:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120913.798752:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.798779:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354816 00000100:00100000:0.0:1789120913.798782:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354816 00000100:00100000:0.0:1789120913.798801:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120913.798807:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+6:14817:x1876028922354816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.798824:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120913.798834:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b400/0x13cfa3d77faa5dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5db5 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798849:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b400/0x13cfa3d77faa5dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5db5 expref: 7 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798857:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b400/0x13cfa3d77faa5dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5db5 expref: 7 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.798863:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b400, rc 0) 00000100:00100000:0.0:1789120913.798888:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+7:14817:x1876028922354816:12345-0@lo:101:mount.lustre.0 Request processed in 80us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.798894:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120913.798926:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d7b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.799100:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.799113:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dbc expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.799121:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5dbc expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.799131:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789120913.799238:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dbc expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.799246:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b600/0x13cfa3d77faa5db5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dbc expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.799262:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789120913.799265:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120913.799270:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ffd82c7a800 10000000:01000000:0.0:1789120913.799272:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789120913.799274:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789120913.799277:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789120913.799291:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.799298:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.799304:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.799316:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120913.799341:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.799372:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.799480:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922354944 00000100:00100000:1.0:1789120913.799485:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922354944 00000100:00100000:1.0:1789120913.799518:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120913.799526:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+7:14817:x1876028922354944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120913.799533:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120913.799541:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa5dca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5dc3 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.799555:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa5dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5dc3 expref: 8 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.799563:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99baa00/0x13cfa3d77faa5dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5dc3 expref: 8 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.799568:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99baa00, rc 0) 00000100:00100000:1.0:1789120913.799604:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+8:14817:x1876028922354944:12345-0@lo:101:mount.lustre.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.799610:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120913.799706:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922354944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.799717:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dca expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.799724:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5dca expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.799762:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.799785:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.799815:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.799858:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355072 00000100:00100000:1.0:1789120913.799863:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355072 00000100:00100000:1.0:1789120913.799892:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120913.799898:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+8:14817:x1876028922355072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120913.800412:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14817:x1876028922355072:12345-0@lo:501:mount.lustre.0 Request processed in 512us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.800420:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120913.800519:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.800547:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120913.800585:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.800658:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.800694:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355200 00000100:00100000:2.0:1789120913.800698:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355200 00000100:00100000:2.0:1789120913.800764:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120913.800773:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14817:x1876028922355200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120913.801123:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14817:x1876028922355200:12345-0@lo:503:mount.lustre.0 Request processed in 350us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.801130:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120913.801380:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120913.801762:0:14853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14853:1876028922355328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.801800:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.801863:0:14853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.801898:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355328 00000100:00100000:1.0:1789120913.801903:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355328 00000100:00100000:1.0:1789120913.802030:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789120913.802038:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14853:x1876028922355328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.802322:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14853:x1876028922355328:12345-0@lo:502:llog_process_th.0 Request processed in 284us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.802329:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120913.802413:0:14853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14853:1876028922355328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120913.802436:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120913.802446:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.802449:0:14853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789120913.802455:0:14853:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789120913.802458:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120913.802472:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ffdb57b9a48) 00000020:00000080:3.0:1789120913.802487:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789120913.802493:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789120913.802560:0:14853:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789120913.802567:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5dd8 00000020:00000080:3.0:1789120913.802763:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789120913.802768:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.802772:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.802774:0:14853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789120913.802776:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120913.802780:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.802781:0:14853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789120913.802785:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120913.802792:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ffdb57bb490) 00000020:00000080:3.0:1789120913.802801:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789120913.802805:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789120913.802807:0:14853:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789120913.802810:0:14853:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789120913.802815:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789120913.802863:0:14853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffd82c7a800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789120913.802876:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ffd8fb84ed8) 00000020:00000080:3.0:1789120913.802885:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789120913.802924:0:14853:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789120913.802929:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa5ded 00000020:00000080:3.0:1789120913.803095:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789120913.803101:0:14853:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789120913.803106:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x13cfa3d77faa5df4 00080000:01000000:3.0:1789120913.803111:0:14853:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789120913.803115:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5dfb 00010000:00010000:3.0:1789120913.877686:0:14853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789120913.878329:0:14853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789120913.878531:0:14853:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789120913.881337:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ffd8fb83490) 00000020:00000080:3.0:1789120913.881360:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789120913.881589:0:14853:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789120913.881597:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5e09 00000020:00000080:2.0:1789120913.882490:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789120913.888690:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x13cfa3d77faa5e10 00000020:00000080:2.0:1789120913.889583:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789120913.889596:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120913.889603:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.889605:0:14853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789120913.889609:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789120913.889612:0:14853:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789120913.889613:0:14853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789120913.889615:0:14853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789120913.889616:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789120913.889619:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.889620:0:14853:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789120913.889623:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120913.889627:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.889629:0:14853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789120913.889634:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789120913.889669:0:14853:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789120913.889681:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120913.889684:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.889685:0:14853:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789120913.889688:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789120913.889691:0:14853:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789120913.889695:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.889696:0:14853:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789120913.889699:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789120913.889704:0:14853:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:2.0:1789120913.889728:0:14853:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789120913.889731:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789120913.889744:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ffc812c9a48) 00000020:00000080:2.0:1789120913.889757:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789120913.889762:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789120913.889813:0:14853:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789120913.889819:0:14853:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789120913.889832:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5e1e 00010000:00080000:2.0:1789120913.889864:0:14853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffd89879800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789120913.891367:0:14853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789120913.891783:0:14853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789120913.891831:0:14853:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789120913.898079:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120913.899606:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789120913.899732:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789120913.901546:0:14857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789120913.901553:0:14857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789120913.904567:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789120913.904582:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789120913.904625:0:14853:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789120913.904644:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa5e25 00000100:00080000:3.0:1789120913.904653:0:14853:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789120913.904659:0:14853:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffd89879800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120913.904690:0:14853:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dda40 x1876028922355456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789120913.904715:0:14853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789120913.904770:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.904773:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.904774:0:14853:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789120913.904777:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789120913.904779:0:14853:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789120913.904781:0:14853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789120913.904782:0:14853:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789120913.904784:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789120913.904786:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.904787:0:14853:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789120913.904798:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789120913.904802:0:14853:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789120913.904806:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.904807:0:14853:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789120913.904810:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789120913.904814:0:14853:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.109@tcp to nid 0x20000c0a8ce6d (192.168.206.109@tcp) 00000020:01000000:3.0:1789120913.904839:0:14853:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789120913.904842:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120913.904852:0:14853:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ffd8fb80000) 00000020:00000080:3.0:1789120913.904863:0:14853:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789120913.904867:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789120913.904918:0:14853:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789120913.904924:0:14853:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789120913.904929:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x13cfa3d77faa5e33 00010000:00080000:3.0:1789120913.904964:0:14853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffdaf530000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:3.0:1789120913.905502:0:14853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789120913.905647:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922355456:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789120913.905705:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028922355456 offset 0 length 520: 4 00000040:01000000:3.0:1789120913.905921:0:14853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789120913.905944:0:14853:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789120913.906790:0:14853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120913.906854:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789120913.906919:0:14853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789120913.907608:0:14859:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789120913.907614:0:14859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789120913.908452:0:14853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789120913.908463:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789120913.908491:0:14853:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789120913.908508:0:14853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa5e3a 00000100:00080000:3.0:1789120913.908518:0:14853:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789120913.908523:0:14853:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffdaf530000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120913.908554:0:14853:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54df480 x1876028922355584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789120913.908581:0:14853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789120913.908675:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.908679:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.908680:0:14853:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789120913.908683:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120913.908687:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.908688:0:14853:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789120913.908692:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789120913.908693:0:14853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789120913.908696:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.908698:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.908700:0:14853:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789120913.908702:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120913.908704:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.908705:0:14853:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789120913.908708:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789120913.908738:0:14853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14853:1876028922355712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120913.908805:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120913.908841:0:14853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8511f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.908902:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922355584:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789120913.908930:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028922355584 offset 0 length 520: 4 00000100:00100000:2.0:1789120913.909018:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355712 00000100:00100000:2.0:1789120913.909025:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355712 00000100:00100000:2.0:1789120913.909092:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789120913.909102:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14853:x1876028922355712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.909517:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14853:x1876028922355712:12345-0@lo:502:llog_process_th.0 Request processed in 415us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.909525:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120913.909655:0:14853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14853:1876028922355712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120913.909681:0:14853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.909686:0:14853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.909687:0:14853:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789120913.909691:0:14853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789120913.909882:0:14817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789120913.909899:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789120913.909945:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dca expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.909957:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a200/0x13cfa3d77faa5dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dca expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120913.909965:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd82c7a800 from 1 10000000:01000000:1.0:1789120913.909968:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120913.909998:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.910007:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.910016:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120913.910031:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789120913.910072:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.910106:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.910189:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355840 00000100:00100000:0.0:1789120913.910195:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355840 00000100:00100000:0.0:1789120913.910218:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120913.910225:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+9:14817:x1876028922355840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.910235:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120913.910247:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5e41 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.910266:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 10 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.910277:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 10 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.910296:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120913.910339:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+10:14817:x1876028922355840:12345-0@lo:101:mount.lustre.0 Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.910345:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120913.910423:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120913.910437:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.910445:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120913.910943:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355968:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789120913.910980:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.911017:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb9563840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.911298:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922355968 00000100:00100000:0.0:1789120913.911303:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922355968 00000100:00100000:0.0:1789120913.911331:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120913.911339:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+10:14817:x1876028922355968:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789120913.911352:0:14830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789120913.911357:0:14830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789120913.911430:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+10:14817:x1876028922355968:12345-0@lo:256:mount.lustre.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.911438:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120913.911518:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922355968:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789120913.912026:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789120913.912358:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.912379:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.912485:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd82c7a800 from 1 10000000:01000000:0.0:1789120913.912490:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120913.912518:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.912526:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.912536:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.912552:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120913.912592:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.912628:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.912682:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356096 00000100:00100000:2.0:1789120913.912688:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356096 00000100:00100000:2.0:1789120913.912726:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120913.912734:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+10:14817:x1876028922356096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120913.912744:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120913.912757:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5e4f expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.912776:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.912786:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.912794:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56600, rc 0) 00000100:00100000:2.0:1789120913.912876:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356096:12345-0@lo:101:mount.lustre.0 Request processed in 142us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.912883:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120913.912986:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120913.913000:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.913010:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120913.913061:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120913.913087:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.913185:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.913335:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356224 00000100:00100000:0.0:1789120913.913340:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356224 00000100:00100000:0.0:1789120913.913417:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120913.913425:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.913776:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356224:12345-0@lo:501:mount.lustre.0 Request processed in 351us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.913783:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789120913.913850:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120913.913882:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789120913.913918:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.914029:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddb480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.914105:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356352 00000100:00100000:2.0:1789120913.914110:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356352 00000100:00100000:2.0:1789120913.914132:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120913.914138:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120913.914370:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356352:12345-0@lo:503:mount.lustre.0 Request processed in 231us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.914396:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789120913.914478:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789120913.914878:0:14861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14861:1876028922356480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.914911:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.914941:0:14861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.914991:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356480 00000100:00100000:2.0:1789120913.914996:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356480 00000100:00100000:2.0:1789120913.915017:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120913.915024:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14861:x1876028922356480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.915236:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14861:x1876028922356480:12345-0@lo:502:llog_process_th.0 Request processed in 212us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.915244:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789120913.915427:0:14861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14861:1876028922356480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120913.915448:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120913.915457:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915459:0:14861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789120913.915465:0:14861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd82c7a800 00000020:00000080:1.0:1789120913.915473:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789120913.915481:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120913.915483:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915484:0:14861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789120913.915487:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120913.915489:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915490:0:14861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789120913.915493:0:14861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd82c7a800 00000020:00000080:1.0:1789120913.915495:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789120913.915555:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120913.915559:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915560:0:14861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789120913.915569:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120913.915572:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915574:0:14861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789120913.915577:0:14861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd82c7a800 00000020:00000080:1.0:1789120913.915580:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789120913.915597:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120913.915600:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915601:0:14861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789120913.915604:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120913.915606:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.915607:0:14861:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789120913.915610:0:14861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd82c7a800 00000020:00000080:1.0:1789120913.915612:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789120913.915643:0:14861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14861:1876028922356608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.915674:0:14861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.915693:0:14861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.915757:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356608 00000100:00100000:0.0:1789120913.915761:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356608 00000100:00100000:0.0:1789120913.915783:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120913.915789:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14861:x1876028922356608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.915905:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14861:x1876028922356608:12345-0@lo:502:llog_process_th.0 Request processed in 116us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.915913:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789120913.915984:0:14861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14861:1876028922356608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120913.916003:0:14861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120913.916007:0:14861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120913.916014:0:14861:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789120913.916017:0:14861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789120913.916177:0:14817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789120913.916193:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120913.916208:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916219:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.916266:0:14817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789120913.916268:0:14817:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffd82c7a800 10000000:01000000:0.0:1789120913.916271:0:14817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffd82c7a800 10000000:01000000:0.0:1789120913.916275:0:14817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120913.916280:0:14817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd82c7a800 from 1 10000000:01000000:0.0:1789120913.916282:0:14817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120913.916305:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916320:0:14817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916329:0:14817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.916345:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120913.916369:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.916403:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356736 00000100:00100000:0.0:1789120913.916407:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356736 00000100:00100000:0.0:1789120913.916424:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120913.916430:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922356736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.916438:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120913.916448:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa5e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5e5d expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916467:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa5e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e5d expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916477:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4a600/0x13cfa3d77faa5e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e5d expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916485:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a600, rc 0) 00000100:00100000:0.0:1789120913.916507:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922356736:12345-0@lo:101:mount.lustre.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.916513:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120913.916542:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.916559:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120913.916570:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e64 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.916579:0:14817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5e64 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.916613:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.916636:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.916655:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356864 00000100:00100000:0.0:1789120913.916658:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356864 00000100:00100000:0.0:1789120913.916674:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120913.916679:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922356864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.916850:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922356864:12345-0@lo:501:mount.lustre.0 Request processed in 169us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.916858:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120913.916878:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.916889:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120913.916911:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120913.916941:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.916959:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922356992 00000100:00100000:0.0:1789120913.916962:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922356992 00000100:00100000:0.0:1789120913.916977:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120913.916982:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922356992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120913.917097:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922356992:12345-0@lo:503:mount.lustre.0 Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.917111:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120913.917136:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.917170:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922356992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120913.925267:0:14862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14862:1876028922357120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.925341:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.925425:0:14862:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.927491:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357120 00000100:00100000:1.0:1789120913.927503:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357120 00000100:00100000:2.0:1789120913.927586:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789120913.927596:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14862:x1876028922357120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.927875:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14862:x1876028922357120:12345-0@lo:502:llog_process_th.0 Request processed in 280us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.927883:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789120913.927941:0:14862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14862:1876028922357120:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789120913.928004:0:14862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789120913.928019:0:14862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ffc812cb490) 00000020:00000080:2.0:1789120913.928036:0:14862:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789120913.928112:0:14862:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffd82c7a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789120913.928116:0:14862:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffd82c7a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789120913.928119:0:14862:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffd82c7a800 4 00010000:00080000:2.0:1789120913.928177:0:14862:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffd873d5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.109@tcp at head 00010000:00010000:2.0:1789120913.930052:0:14862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789120913.930339:0:14862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789120913.930371:0:14862:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789120913.930395:0:14862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x13cfa3d77faa5e72 00000100:00080000:2.0:1789120913.930405:0:14862:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120913.930410:0:14862:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ffd873d5000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:2.0:1789120913.930442:0:14862:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffc83460b40 x1876028922357248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120913.930468:0:14862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789120913.931988:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922357248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789120913.932061:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.932259:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357248 00000100:00100000:0.0:1789120913.932266:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357248 00000100:00100000:0.0:1789120913.932295:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120913.932302:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922357248:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789120913.932355:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922357248:12345-0@lo:38:llog_process_th.0 Request processed in 52us (293us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789120913.932362:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120913.932408:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789120913.932415:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd873d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789120913.932419:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789120913.932423:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922357248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789120913.935797:0:14862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14862:1876028922357376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.935873:0:14862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.935912:0:14862:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.935930:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357376 00000100:00100000:2.0:1789120913.935949:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357376 00000100:00100000:2.0:1789120913.935997:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789120913.936006:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14862:x1876028922357376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.936256:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14862:x1876028922357376:12345-0@lo:502:llog_process_th.0 Request processed in 250us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.936265:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789120913.936314:0:14862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14862:1876028922357376:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789120913.936340:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789120913.936444:0:14817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789120913.936466:0:14817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120913.936482:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e64 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.936492:0:14817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4a800/0x13cfa3d77faa5e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e64 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789120913.936533:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789120913.936535:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.936540:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.936541:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.936542:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.936543:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.936544:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.936545:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.936547:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.936548:0:14817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120913.936551:0:14817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789120913.936554:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120913.936555:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.936556:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.936557:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.936558:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.936558:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.936559:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.936560:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.936561:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.936562:0:14817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789120913.936575:0:14817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789120913.936585:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922357504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789120913.936617:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.936638:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d2bc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120913.937233:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357504 00000100:00100000:3.0:1789120913.937239:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357504 00000100:00100000:3.0:1789120913.937277:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120913.937286:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14817:x1876028922357504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789120913.937312:0:14828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789120913.937326:0:14828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789120913.979794:0:14828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789120913.979812:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789120913.981106:0:14851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789120913.981113:0:14851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789120913.981137:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.981344:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.981369:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.981417:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120913.981432:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 12 pid: 14828 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120913.981444:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922357632:0@lo:104: 00000100:00100000:2.0:1789120913.981504:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.981599:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdb94ec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.981683:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357632 00000100:00100000:1.0:1789120913.981691:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357632 00000100:00100000:1.0:1789120913.981779:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120913.981789:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922357632:12345-0@lo:104: 00010000:00010000:1.0:1789120913.981802:0:14818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.981903:0:14818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120913.981909:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922357632:12345-0@lo:104: Request processed in 123us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.981916:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120913.982106:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922357632:0@lo:104: 00010000:00010000:0.0:1789120913.982126:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982305:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120913.982311:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982320:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120913.982324:0:14824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982341:0:14824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120913.982348:0:14824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.982354:0:14824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120913.982691:0:14824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982699:0:14824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120913.982723:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982731:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba800/0x13cfa3d77faa5e41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e48 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.982746:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.982748:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120913.982750:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120913.982769:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120913.982778:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922357760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120913.982816:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.983051:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357760 00000100:00100000:1.0:1789120913.983057:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357760 00010000:00010000:1.0:1789120913.983076:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 13 pid: 14828 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120913.983108:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120913.983115:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+13:3317:x1876028922357760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120913.983125:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120913.983130:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 13 pid: 14828 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983159:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 13 pid: 14828 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983175:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa5e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5e41 expref: 13 pid: 14828 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983197:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983205:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789120913.983218:0:14820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002105661s 00010000:00010000:1.0:1789120913.983222:0:14820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983230:0:14820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983237:0:14820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983243:0:14820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983249:0:14820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120913.983252:0:14820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983260:0:14820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983274:0:14820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983282:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120913.983320:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3317:x1876028922357760:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.983328:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120913.983357:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922357760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120913.983377:0:14851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983398:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.983404:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0b57c00/0x13cfa3d77faa5e79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120913.986105:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14817:x1876028922357504:12345-0@lo:253:mount.lustre.0 Request processed in 48812us (49480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.986119:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120913.986183:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14817:1876028922357504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789120913.986199:0:14817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789120913.986202:0:14817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120913.986204:0:14817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120913.986205:0:14817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120913.986206:0:14817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120913.986218:0:14817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120913.986219:0:14817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120913.986221:0:14817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120913.986222:0:14817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120913.986224:0:14817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120913.986225:0:14817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789120913.986239:0:14817:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789120913.992453:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.992590:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120913.992840:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.992965:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120913.993215:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.993345:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120913.997831:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.997967:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120913.998187:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.998472:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120913.998738:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120913.999046:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789120914.032244:0:14817:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789120914.033320:0:14817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789120914.033495:0:14873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789120914.033499:0:14873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789120914.033623:0:14874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789120914.033827:0:14874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120914.039867:0:14874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789120914.039931:0:14874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789120914.039935:0:14874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789120914.040257:0:14817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789120914.040407:0:14817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789120914.042225:0:14817:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789120914.042244:0:14817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789120914.042771:0:14817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120914.044759:0:14817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789120914.045755:0:14817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789120914.045804:0:14817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789120914.049419:0:14817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789120914.054856:0:14817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789120914.094117:0:14817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789120914.094334:0:14817:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb0ac1cd7988 00100000:10000000:2.0:1789120914.094343:0:14817:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789120914.095091:0:14817:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789120914.095103:0:14817:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789120914.095114:0:14817:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789120914.095130:0:14817:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789120914.667375:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120914.986864:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789120915.434441:0:14833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789120915.434449:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd82c7a800 from 6 10000000:01000000:2.0:1789120915.434454:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789120915.434499:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120915.434510:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120915.434521:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120915.434552:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922357888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120915.434622:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120915.434692:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120915.435277:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922357888 00000100:00100000:0.0:1789120915.435287:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922357888 00000100:00100000:0.0:1789120915.435335:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120915.435347:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14833:x1876028922357888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120915.435361:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120915.435386:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5e80 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120915.435416:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120915.435442:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120915.435451:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b200, rc 0) 00000100:00100000:0.0:1789120915.435506:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922357888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120915.435513:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789120915.436016:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922357888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120915.436036:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120915.436046:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120915.436118:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789120915.436271:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120915.436315:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120915.436420:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358016 00000100:00100000:1.0:1789120915.436426:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358016 00000100:00100000:1.0:1789120915.436466:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120915.436475:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789120915.436493:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789120915.436511:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789120915.436515:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789120915.436603:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.436611:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120915.437010:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789120915.437061:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789120915.437069:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120915.437078:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120915.690885:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120916.012281:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789120916.714294:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789120917.423253:0:15116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789120917.739245:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120918.762868:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120919.274394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789120919.274402:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789120919.274405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789120919.274408:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789120919.274411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789120919.274414:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789120919.274418:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ffd873d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789120919.274430:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ffd873d5000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789120919.274453:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb598cb40 x1876028922358272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120919.274518:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120919.274542:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922358144:0@lo:400:kworker.0 00000100:00100000:1.0:1789120919.274636:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120919.274701:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922358272:0@lo:38:kworker.0 00000100:00100000:1.0:1789120919.275041:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120919.275084:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358144 00000100:00100000:1.0:1789120919.275091:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358144 00000100:00100000:1.0:1789120919.275131:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120919.275140:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3320:x1876028922358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120919.275216:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3320:x1876028922358144:12345-0@lo:400:kworker.0 Request processed in 77us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120919.275224:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120919.275286:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922358144:0@lo:400:kworker.0 00000100:00100000:2.0:1789120919.275756:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358272 00000100:00100000:2.0:1789120919.275762:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358272 00000100:00100000:2.0:1789120919.275782:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120919.275788:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876028922358272:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789120919.275808:0:14837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1789120919.275838:0:14837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x13cfa3d77faa5e8e 00000004:00100000:2.0:1789120919.275852:0:14837:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789120919.275998:0:14837:0:(import.c:65:import_set_state_nolock()) ffff9ffd873d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120919.276044:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876028922358272:12345-0@lo:38:kworker.0 Request processed in 255us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120919.276051:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789120919.277300:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffdb598cb40 x1876028922358272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789120919.277318:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789120919.277325:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789120919.277330:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789120919.279928:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd873d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789120919.279947:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876028922358272:0@lo:38:kworker.0 00010000:00010000:2.0:1789120919.786937:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789120920.408233:0:15267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc6e08eb0 20000000:00000080:1.0:1789120920.408249:0:15267:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffdb573bc00 uarg=0000000000000000 20000000:01000000:1.0:1789120920.408281:0:15267:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789120920.408287:0:15267:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789120920.408291:0:15267:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789120920.409055:0:15268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789120920.409231:0:15267:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789120920.419128:0:15267:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789120920.419189:0:15267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.419209:0:15267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.419217:0:15267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.419259:0:15267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.419276:0:15267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120920.419307:0:15267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15267:1876028922358400:0@lo:104: 00000100:00100000:1.0:1789120920.420618:0:15267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120920.420672:0:15267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120920.420740:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358400 00000100:00100000:0.0:1789120920.420749:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358400 00000100:00100000:0.0:1789120920.420802:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120920.420812:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:15267:x1876028922358400:12345-0@lo:104: 00010000:00010000:0.0:1789120920.420826:0:14818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120920.420913:0:14818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120920.420919:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:15267:x1876028922358400:12345-0@lo:104: Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.420926:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789120920.420986:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120920.420993:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421001:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4ba00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120920.421005:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421014:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120920.421022:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120920.421028:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120920.421068:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421075:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120920.421095:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421103:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4ba00/0x13cfa3d77faa5e4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e56 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421121:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120920.421123:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120920.421134:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120920.421169:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922358528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120920.421205:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.421242:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358528 00000100:00100000:3.0:1789120920.421245:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358528 00010000:00010000:3.0:1789120920.421265:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 12 pid: 14830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.421299:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120920.421307:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3320:x1876028922358528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120920.421317:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120920.421321:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 12 pid: 14830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421332:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 12 pid: 14830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421359:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421367:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421380:0:14820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421386:0:14820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421393:0:14820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421409:0:14820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421415:0:14820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120920.421419:0:14820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421427:0:14820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421435:0:14820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.421445:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120920.421474:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3320:x1876028922358528:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.421481:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120920.421512:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922358528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120920.421704:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa5e56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5e4f expref: 11 pid: 14830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120920.421714:0:15267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15267:1876028922358400:0@lo:104: 00010000:00010000:1.0:1789120920.421727:0:15267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.421734:0:15267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.421740:0:15267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.421745:0:15267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa5e95 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.810252:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789120921.834394:0:14833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120921.834404:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd82c7a800 from 13 10000000:01000000:1.0:1789120921.834411:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120921.834468:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120921.834481:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120921.834494:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120921.834537:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120921.834632:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120921.834687:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82b04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120921.834933:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358656 00000100:00100000:0.0:1789120921.834943:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358656 00000100:00100000:0.0:1789120921.835005:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120921.835015:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+11:14833:x1876028922358656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120921.835032:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120921.835047:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5e9c expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120921.835087:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120921.835098:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120921.835110:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ae00, rc 0) 00000100:00100000:0.0:1789120921.835179:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120921.835186:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120921.835246:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120921.835263:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120921.835273:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120921.835334:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120921.835374:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120921.835458:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fb97540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120921.835474:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358784 00000100:00100000:0.0:1789120921.835478:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358784 00000100:00100000:0.0:1789120921.835501:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120921.835509:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358784:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1789120921.835813:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120921.836842:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1322us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120921.836867:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120921.839982:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120921.840077:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120921.840209:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120921.840265:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120921.840290:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922358912 00000100:00100000:2.0:1789120921.840297:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922358912 00000100:00100000:2.0:1789120921.840367:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120921.840378:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120921.840700:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:14833:x1876028922358912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120921.840709:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120921.840768:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922358912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789120921.847089:0:15335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789120921.849679:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789120921.849722:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120921.849737:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120921.849752:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120922.859318:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120923.370314:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120913/real 1789120913] req@ffff9ffdb54df480 x1876028922355584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120923.370361:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb54df480 x1876028922355584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120923.370373:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120913/real 1789120913] req@ffff9ffdb54dda40 x1876028922355456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120923.370386:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb54dda40 x1876028922355456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789120923.370403:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789120923.370421:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789120923.370425:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922355584:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789120923.370431:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd89879800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789120923.370450:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789120923.370454:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922355456:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789120923.372758:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922359040:0@lo:400:kworker.0 00000100:00100000:1.0:1789120923.372824:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120923.372905:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359040 00000100:00080000:3.0:1789120923.372911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789120923.372912:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359040 00000100:00080000:3.0:1789120923.372915:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789120923.372919:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ffd89879800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120923.372924:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 381 00000100:00080000:3.0:1789120923.372928:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789120923.372933:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffd89879800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120923.372954:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54de940 x1876028922359168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120923.372956:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789120923.372964:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3317:x1876028922359040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789120923.372982:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120923.372996:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789120923.372998:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120923.373001:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 381 00000100:00080000:3.0:1789120923.373004:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789120923.373595:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffdaf530000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120923.373614:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dcf00 x1876028922359296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789120923.373672:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789120923.373727:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120923.381515:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:3317:x1876028922359040:12345-0@lo:400:kworker.0 Request processed in 8480us (8620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120923.381530:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789120923.381716:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359424 00000100:00100000:0.0:1789120923.381724:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359424 00000100:00100000:0.0:1789120923.381759:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120923.381767:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922359424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120923.381830:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922359424:12345-0@lo:400:kworker.0 Request processed in 64us (8103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120923.381837:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120923.382453:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922359168:0@lo:8:kworker.0 00010000:00080000:0.0:1789120923.382698:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffdb54de1c0 x1876028922359424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120923.382713:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922359424:0@lo:400:kworker.0 00000400:00000100:1.0:1789120923.384693:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028922359168 offset 0 length 520: 4 00000100:00100000:1.0:1789120923.384741:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922359296:0@lo:8:kworker.0 00000400:00000100:1.0:1789120923.384770:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028922359296 offset 0 length 520: 4 00000100:00100000:1.0:1789120923.384813:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922359040:0@lo:400:kworker.0 00010000:00010000:3.0:1789120923.883242:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120924.913822:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789120925.325794:0:15515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789120925.325798:0:15515:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789120925.325987:0:15515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ffdaa06b800 00000020:01000004:2.0:1789120925.326003:0:15515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789120925.326014:0:15515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789120925.326027:0:15515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ffc812cced8) 00000020:00000080:2.0:1789120925.326044:0:15515:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789120925.355687:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789120925.356085:0:15515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789120925.357107:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789120925.357673:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789120925.358046:0:15515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789120925.358621:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 357: rc = 0 00100000:10000000:3.0:1789120925.358779:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 357: rc = 0 00100000:10000000:3.0:1789120925.359018:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 357: rc = 0 00100000:10000000:3.0:1789120925.359612:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 520: rc = 0 00100000:10000000:3.0:1789120925.360003:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 520: rc = 0 00100000:10000000:3.0:1789120925.360433:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 520: rc = 0 00100000:10000000:3.0:1789120925.360682:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 520: rc = 0 00100000:10000000:3.0:1789120925.361092:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 520: rc = 0 00100000:10000000:3.0:1789120925.361667:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 520: rc = 0 00000020:00000080:3.0:1789120925.362567:0:15515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789120925.362578:0:15515:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789120925.362587:0:15515:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x13cfa3d77faa5eb1 00000020:01000004:3.0:1789120925.362595:0:15515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789120925.362624:0:15515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789120925.362628:0:15515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789120925.362634:0:15515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789120925.362638:0:15515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789120925.362649:0:15515:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ffd8fb81a48) 00000020:00000080:3.0:1789120925.362659:0:15515:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789120925.364112:0:15515:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120925.365091:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789120925.365099:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789120925.365638:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789120925.365647:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789120925.365878:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120925.365884:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789120925.367395:0:15515:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120925.367563:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789120925.367569:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789120925.368265:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789120925.368272:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789120925.385586:0:15515:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789120925.386033:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789120925.386041:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789120925.388292:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789120925.388305:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789120925.392030:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120925.392044:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789120925.394678:0:15515:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120925.395011:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789120925.395018:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789120925.395664:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789120925.395672:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789120925.440385:0:15515:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120925.440594:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789120925.440600:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789120925.444545:0:15515:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789120925.444559:0:15515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789120925.445345:0:15515:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789120925.445437:0:15515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789120925.445444:0:15515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789120925.458388:0:15515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789120925.458424:0:15515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.109@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789120925.458428:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789120925.458430:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120925.458431:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120925.458433:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120925.458434:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120925.458440:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120925.458441:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120925.458443:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120925.458445:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789120925.458448:0:15515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789120925.458450:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789120925.458451:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120925.458452:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120925.458453:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120925.458455:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120925.458455:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120925.458456:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120925.458457:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120925.458458:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789120925.458482:0:15515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789120925.458500:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359552:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789120925.458572:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.458685:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdaf501180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.458771:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359552 00000100:00100000:0.0:1789120925.458779:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359552 00000100:00100000:0.0:1789120925.458940:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120925.458950:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:15515:x1876028922359552:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789120925.458981:0:14828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789120925.458992:0:14828:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789120925.458996:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789120925.467190:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:15515:x1876028922359552:12345-0@lo:253:mount.lustre.0 Request processed in 8234us (8609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.467203:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120925.467304:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359552:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789120925.467318:0:15515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789120925.467345:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789120925.467347:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120925.467348:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120925.467350:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120925.467351:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120925.467352:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120925.467354:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120925.467356:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120925.467357:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789120925.467373:0:15515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffdaa06b800 from lustre-OST0000 10000000:01000000:3.0:1789120925.467399:0:15515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789120925.467402:0:15515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789120925.467409:0:15515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffdb57bced8 local copy 00010000:00010000:3.0:1789120925.467420:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120925.467794:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789120925.467834:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.467868:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.467948:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359680 00000100:00100000:0.0:1789120925.467954:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359680 00000100:00100000:0.0:1789120925.467995:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789120925.468005:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:15515:x1876028922359680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120925.468189:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:15515:x1876028922359680:12345-0@lo:501:mount.lustre.0 Request processed in 185us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120925.468198:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120925.468390:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359680:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789120925.468404:0:15515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789120925.468549:0:15515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789120925.468556:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.468567:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120925.468598:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffdaa06b800 10000000:01000000:3.0:1789120925.468603:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789120925.468608:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ffdb57bced8 10000000:01000000:3.0:1789120925.468618:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789120925.468622:0:15515:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ffdb57bced8 from 1 10000000:01000000:3.0:1789120925.468625:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789120925.468649:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.468657:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.468665:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120925.468679:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789120925.468710:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.468748:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.468808:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359808 00000100:00100000:2.0:1789120925.468813:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359808 00000100:00100000:2.0:1789120925.468846:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789120925.468853:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+12:15515:x1876028922359808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120925.468861:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120925.468873:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0b56000/0x13cfa3d77faa5ec6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5ebf expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.468893:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0b56000/0x13cfa3d77faa5ec6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ebf expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.468902:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0b56000/0x13cfa3d77faa5ec6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ebf expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.468932:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56000, rc 0) 00000100:00100000:2.0:1789120925.468972:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+13:15515:x1876028922359808:12345-0@lo:101:mount.lustre.0 Request processed in 120us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.468979:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120925.469223:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789120925.469236:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ec6 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.469246:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5ec6 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120925.469262:0:15515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789120925.469281:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ec6 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.469289:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81690000/0x13cfa3d77faa5ebf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ec6 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120925.469295:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789120925.469305:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789120925.469309:0:15515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789120925.469311:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789120925.469338:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.469346:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.469352:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120925.469365:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789120925.469395:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.469428:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.469601:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922359936 00000100:00100000:0.0:1789120925.469606:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922359936 00000100:00100000:0.0:1789120925.469643:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789120925.469651:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+13:15515:x1876028922359936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120925.469660:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120925.469669:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4a000/0x13cfa3d77faa5ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5ecd expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.469685:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4a000/0x13cfa3d77faa5ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ecd expref: 14 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.469694:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4a000/0x13cfa3d77faa5ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ecd expref: 14 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.469701:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4a000, rc 0) 00000100:00100000:0.0:1789120925.469741:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922359936:12345-0@lo:101:mount.lustre.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.469747:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120925.470026:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922359936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789120925.470038:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ed4 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.470045:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5ed4 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120925.470732:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789120925.472661:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120925.473241:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789120925.473293:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789120925.473342:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789120925.473394:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789120925.473433:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789120925.473469:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789120925.473552:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789120925.473560:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789120925.473645:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789120925.473711:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.473832:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.474057:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360064 00000100:00100000:0.0:1789120925.474064:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360064 00000100:00100000:0.0:1789120925.474183:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789120925.474193:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120925.474540:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360064:12345-0@lo:501:mount.lustre.0 Request processed in 348us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.474549:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120925.474650:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789120925.474688:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789120925.474730:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.474881:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.475107:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360192 00000100:00100000:2.0:1789120925.475113:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360192 00000100:00100000:2.0:1789120925.475140:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789120925.475229:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120925.475775:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360192:12345-0@lo:503:mount.lustre.0 Request processed in 546us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.475783:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120925.476297:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789120925.477372:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120925.477449:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789120925.477517:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.477594:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.477630:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360320 00000100:00100000:2.0:1789120925.477636:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360320 00000100:00100000:2.0:1789120925.477717:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789120925.477728:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120925.478096:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360320:12345-0@lo:502:mount.lustre.0 Request processed in 369us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.478104:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120925.478201:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789120925.478455:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789120925.478509:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789120925.478544:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789120925.478597:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789120925.478636:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789120925.478688:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789120925.478757:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789120925.478799:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789120925.478834:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789120925.478899:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789120925.478949:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789120925.479004:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789120925.479045:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789120925.479091:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.479522:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.479619:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360448 00000100:00100000:0.0:1789120925.479626:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360448 00000100:00100000:0.0:1789120925.479663:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120925.479672:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120925.480048:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360448:12345-0@lo:502:mount.lustre.0 Request processed in 376us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.480056:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120925.480184:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789120925.480267:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789120925.480278:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789120925.481499:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789120925.481508:0:15529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789120925.481515:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.481517:0:15529:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789120925.481523:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120925.481538:0:15529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ffd955d3490) 00000020:00000080:3.0:1789120925.481560:0:15529:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789120925.481566:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789120925.481644:0:15529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdaa06b800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789120925.481652:0:15529:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789120925.481660:0:15529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x13cfa3d77faa5ee2 00010000:00010000:3.0:1789120925.487570:0:15529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789120925.488214:0:15529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789120925.491629:0:15529:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789120925.494015:0:15529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789120925.494028:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120925.494033:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494035:0:15529:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789120925.494039:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789120925.494042:0:15529:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789120925.494044:0:15529:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789120925.494045:0:15529:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789120925.494047:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789120925.494049:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494050:0:15529:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789120925.494060:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120925.494063:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494065:0:15529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789120925.494068:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789120925.494069:0:15529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789120925.494072:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120925.494074:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494075:0:15529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789120925.494078:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120925.494080:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494082:0:15529:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789120925.494085:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789120925.494120:0:15529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120925.494124:0:15529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.494125:0:15529:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789120925.494129:0:15529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789120925.495355:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789120925.495388:0:15515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789120925.495446:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ed4 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.495459:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd81690600/0x13cfa3d77faa5ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ed4 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120925.495467:0:15515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaa06b800 from 1 10000000:01000000:0.0:1789120925.495470:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120925.495507:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.495516:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.495527:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120925.495558:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789120925.495621:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120925.495671:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3fbf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120925.496487:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360576 00000100:00100000:3.0:1789120925.496496:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360576 00000100:00100000:3.0:1789120925.496534:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120925.496543:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+14:15515:x1876028922360576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789120925.496555:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120925.496572:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5ee9 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.496592:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 15 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.496602:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 15 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.496611:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81690400, rc 0) 00000100:00100000:3.0:1789120925.496658:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360576:12345-0@lo:101:mount.lustre.0 Request processed in 116us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120925.496671:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120925.497513:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120925.497535:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.497546:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789120925.498314:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789120925.498685:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120925.499299:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789120925.499801:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789120925.500092:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789120925.500101:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789120925.500270:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120925.500341:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120925.500418:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3fbf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.500586:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360704 00000100:00100000:2.0:1789120925.500593:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360704 00000100:00100000:2.0:1789120925.500670:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120925.500680:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120925.501459:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360704:12345-0@lo:501:mount.lustre.0 Request processed in 778us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.501469:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120925.501568:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120925.501608:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789120925.501651:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120925.501683:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.501731:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360832 00000100:00100000:0.0:1789120925.501736:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360832 00000100:00100000:0.0:1789120925.501811:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789120925.501831:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120925.502075:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360832:12345-0@lo:503:mount.lustre.0 Request processed in 254us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.502081:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120925.502188:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789120925.502811:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789120925.502886:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789120925.503178:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.503583:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922360960 00000100:00100000:3.0:1789120925.503591:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922360960 00000100:00100000:2.0:1789120925.503751:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120925.503760:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120925.504133:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922360960:12345-0@lo:502:mount.lustre.0 Request processed in 374us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.504179:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120925.504334:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120925.504356:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922360960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789120925.504794:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789120925.504868:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789120925.505112:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789120925.505190:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789120925.505229:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789120925.505281:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789120925.505331:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789120925.505372:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789120925.505422:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789120925.505458:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789120925.505518:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789120925.505556:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789120925.505613:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.506403:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.506462:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361088 00000100:00100000:0.0:1789120925.506469:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361088 00000100:00100000:0.0:1789120925.506508:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120925.506516:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922361088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120925.507129:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922361088:12345-0@lo:502:mount.lustre.0 Request processed in 610us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.507138:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789120925.507341:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789120925.507443:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789120925.507456:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789120925.508686:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120925.508696:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120925.508699:0:15533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789120925.508706:0:15533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdaa06b800 00000020:00000080:2.0:1789120925.508708:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120925.508716:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120925.508719:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120925.508720:0:15533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789120925.508722:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120925.508725:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120925.508726:0:15533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789120925.508729:0:15533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffdaa06b800 00000020:00000080:2.0:1789120925.508731:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120925.508829:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120925.508833:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120925.508834:0:15533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789120925.508837:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120925.508840:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120925.508841:0:15533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120925.508845:0:15533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdaa06b800 00000020:00000080:2.0:1789120925.508847:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120925.511319:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120925.515316:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.515334:0:15533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120925.515348:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120925.515356:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.515358:0:15533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789120925.515364:0:15533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffdaa06b800 00000020:00000080:3.0:1789120925.515374:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120925.515531:0:15533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120925.515535:0:15533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120925.515536:0:15533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789120925.515540:0:15533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789120925.516648:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789120925.516686:0:15515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120925.516708:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.516732:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120925.516781:0:15515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789120925.516784:0:15515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffdaa06b800 10000000:01000000:2.0:1789120925.516787:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffdaa06b800 10000000:01000000:2.0:1789120925.516792:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120925.516798:0:15515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffdaa06b800 from 1 10000000:01000000:2.0:1789120925.516800:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120925.516846:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.516854:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.516865:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120925.516902:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789120925.517113:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.517177:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361216 00000100:00100000:2.0:1789120925.517184:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361216 00000100:00100000:2.0:1789120925.517223:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789120925.517231:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922361216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120925.517242:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120925.517253:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0b57000/0x13cfa3d77faa5efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5ef7 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.517284:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0b57000/0x13cfa3d77faa5efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ef7 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.517293:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0b57000/0x13cfa3d77faa5efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ef7 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.517301:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57000, rc 0) 00000100:00100000:2.0:1789120925.517344:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361216:12345-0@lo:101:mount.lustre.0 Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.517351:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789120925.517399:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.517420:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120925.517435:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5efe expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120925.517445:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5efe expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120925.518981:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789120925.519486:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120925.519757:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789120925.519803:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789120925.519838:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789120925.519893:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789120925.522252:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789120925.522353:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789120925.522416:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789120925.522455:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789120925.522538:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789120925.522581:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789120925.526178:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789120925.526306:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789120925.526362:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789120925.526398:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789120925.526447:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789120925.526484:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789120925.526521:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789120925.526571:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789120925.526608:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789120925.526639:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789120925.526684:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789120925.526714:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789120925.526767:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789120925.528004:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789120925.528082:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789120925.528116:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789120925.528192:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789120925.528231:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789120925.528317:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789120925.528337:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789120925.528434:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120925.531136:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.531207:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.531442:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361344 00000100:00100000:0.0:1789120925.531451:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361344 00000100:00100000:0.0:1789120925.531493:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789120925.531501:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120925.531754:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361344:12345-0@lo:501:mount.lustre.0 Request processed in 252us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.531762:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789120925.532690:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120925.532743:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120925.532793:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.533009:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361472 00000100:00100000:2.0:1789120925.533015:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361472 00000100:00100000:2.0:1789120925.533061:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789120925.533068:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120925.533257:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361472:12345-0@lo:503:mount.lustre.0 Request processed in 188us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.533265:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789120925.533317:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.533342:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789120925.536421:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789120925.536802:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120925.537055:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.537092:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361600 00000100:00100000:2.0:1789120925.537099:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361600 00000100:00100000:2.0:1789120925.537138:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789120925.537628:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120925.538414:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361600:12345-0@lo:502:mount.lustre.0 Request processed in 789us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120925.538424:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789120925.538491:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120925.538512:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789120925.538768:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789120925.538835:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789120925.538888:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789120925.539286:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789120925.539343:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789120925.539396:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789120925.539446:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789120925.539482:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789120925.539546:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789120925.539585:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789120925.539617:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789120925.539738:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789120925.539778:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789120925.539825:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789120925.539889:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789120925.540226:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789120925.540269:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789120925.540314:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789120925.540368:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789120925.540406:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789120925.540452:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789120925.540701:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789120925.540761:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789120925.540829:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789120925.541002:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789120925.541048:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789120925.541120:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789120925.541297:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789120925.541352:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789120925.541409:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789120925.541470:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789120925.541512:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789120925.541547:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789120925.541599:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789120925.541637:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789120925.541681:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789120925.541716:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789120925.541751:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789120925.542023:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789120925.542066:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789120925.542118:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120925.542225:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120925.542276:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.545083:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361728 00000100:00100000:0.0:1789120925.545095:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361728 00000100:00100000:0.0:1789120925.545174:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789120925.545185:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120925.545473:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361728:12345-0@lo:502:mount.lustre.0 Request processed in 290us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.545481:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120925.547267:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789120925.547421:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789120925.547436:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789120925.548832:0:15538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789120925.548846:0:15538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ffdb9aa3490) 00000020:00000080:1.0:1789120925.548865:0:15538:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789120925.549039:0:15538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffdaa06b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120925.549044:0:15538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffdaa06b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120925.549047:0:15538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffdaa06b800 3 00010000:00080000:1.0:1789120925.549077:0:15538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffd9d39c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.109@tcp at head 00010000:00010000:1.0:1789120925.555344:0:15538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789120925.555558:0:15538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789120925.555593:0:15538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789120925.555606:0:15538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x13cfa3d77faa5f0c 00000100:00080000:1.0:1789120925.555616:0:15538:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120925.555622:0:15538:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ffd9d39c000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:1.0:1789120925.555656:0:15538:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb598fc00 x1876028922361856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120925.555700:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922361856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789120925.555777:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120925.555849:0:15538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789120925.558181:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361856 00000100:00100000:1.0:1789120925.558196:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361856 00000100:00100000:1.0:1789120925.558249:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120925.558258:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876028922361856:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789120925.558288:0:14835:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:1.0:1789120925.558340:0:14835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x13cfa3d77faa5f13 00000004:00100000:1.0:1789120925.558357:0:14835:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789120925.558395:0:14835:0:(import.c:65:import_set_state_nolock()) ffff9ffc83efb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120925.558633:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876028922361856:12345-0@lo:38:llog_process_th.0 Request processed in 374us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120925.558641:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789120925.558765:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffdb598fc00 x1876028922361856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120925.558786:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120925.558794:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789120925.558803:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789120925.558808:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789120925.558992:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d39c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789120925.559000:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876028922361856:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789120925.561087:0:15538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789120925.561283:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789120925.561308:0:15515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120925.561335:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5efe expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.561347:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0b57400/0x13cfa3d77faa5ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5efe expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789120925.561394:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789120925.561397:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120925.561398:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120925.561399:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120925.561400:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120925.561401:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120925.561403:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120925.561404:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120925.561406:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120925.561410:0:15515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789120925.561412:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120925.561413:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120925.561414:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120925.561416:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120925.561417:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120925.561418:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120925.561419:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120925.561420:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120925.561421:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120925.561450:0:15515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789120925.561469:0:15515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789120925.561534:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120925.561578:0:15515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd9d3a9cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1789120925.562204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120925.562210:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789120925.562212:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120925.562215:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789120925.562263:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120925.562274:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922362112:0@lo:400:kworker.0 00000100:00100000:3.0:1789120925.562317:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120925.563066:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362112 00000100:00100000:0.0:1789120925.563075:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362112 00000100:00100000:0.0:1789120925.563123:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120925.563132:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922362112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120925.563213:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922362112:12345-0@lo:400:kworker.0 Request processed in 82us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.563232:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789120925.563274:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ffdb54dc000 x1876028922362112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120925.563288:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922362112:0@lo:400:kworker.0 00000100:00100000:1.0:1789120925.564204:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922361984 00000100:00100000:1.0:1789120925.564213:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922361984 00000100:00100000:1.0:1789120925.564254:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120925.564262:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:15515:x1876028922361984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789120925.564288:0:14828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789120925.564301:0:14828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789120925.594615:0:14828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789120925.594627:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789120925.595771:0:14851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789120925.595776:0:14851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789120925.595795:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.595812:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.595820:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.595857:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.595879:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 16 pid: 14829 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120925.595901:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922362240:0@lo:104: 00000100:00100000:1.0:1789120925.595961:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120925.596011:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdafddbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120925.596080:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362240 00000100:00100000:0.0:1789120925.596087:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362240 00000100:00100000:0.0:1789120925.596126:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120925.596134:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922362240:12345-0@lo:104: 00010000:00010000:0.0:1789120925.596166:0:14818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120925.596214:0:14818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120925.596219:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922362240:12345-0@lo:104: Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120925.596226:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789120925.596329:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120925.596336:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.596344:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120925.596348:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.596357:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120925.596364:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120925.596370:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789120925.596405:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922362240:0@lo:104: 00010000:00010000:3.0:1789120925.596410:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.596416:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120925.596422:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120925.596436:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120925.596439:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789120925.596442:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56e00/0x13cfa3d77faa5e80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5e87 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120925.596448:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922362368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120925.596456:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120925.596457:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120925.596459:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120925.596473:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120925.596507:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362368 00000100:00100000:1.0:1789120925.596511:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362368 00010000:00010000:1.0:1789120925.596526:0:14822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 17 pid: 14829 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120925.596550:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120925.596556:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:3319:x1876028922362368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120925.596564:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120925.596568:0:14822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 17 pid: 14829 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596577:0:14822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 17 pid: 14829 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596590:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4b200/0x13cfa3d77faa5e87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5e80 expref: 17 pid: 14829 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596602:0:14822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596615:0:14822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789120925.596626:0:14822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002105661s 00010000:00010000:1.0:1789120925.596631:0:14822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596637:0:14822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596643:0:14822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596649:0:14822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596654:0:14822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120925.596658:0:14822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596665:0:14822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596678:0:14822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596686:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120925.596712:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3319:x1876028922362368:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120925.596719:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120925.596748:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922362368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120925.596761:0:14851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596768:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120925.596774:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa5f1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120925.605441:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:15515:x1876028922361984:12345-0@lo:253:mount.lustre.0 Request processed in 41101us (43827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120925.605456:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789120925.605486:0:15515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:15515:1876028922361984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789120925.605501:0:15515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789120925.605505:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120925.605507:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789120925.605508:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120925.605509:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120925.605511:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120925.605512:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120925.605514:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789120925.605516:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120925.605517:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789120925.605531:0:15515:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789120925.614432:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120925.614610:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789120925.614766:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120925.615016:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789120925.615250:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789120925.615418:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789120925.617073:0:15515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789120925.671365:0:15515:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789120925.671373:0:15515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789120925.671418:0:15515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789120925.671476:0:15515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789120925.671488:0:15515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789120925.671515:0:15515:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789120925.940782:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120926.255762:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789120926.954810:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789120927.147505:0:14833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789120927.147512:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd82c7a800 from 7 10000000:01000000:1.0:1789120927.147517:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120927.147680:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120927.147692:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120927.147703:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120927.147726:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922362496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120927.148138:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120927.152623:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120927.152747:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362496 00000100:00100000:3.0:1789120927.152756:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362496 00000100:00100000:3.0:1789120927.152828:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789120927.152837:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+15:14833:x1876028922362496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120927.152854:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120927.152873:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa5f21 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120927.152898:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120927.152909:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 16 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120927.152917:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd81691000, rc 0) 00000100:00100000:3.0:1789120927.152984:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:14833:x1876028922362496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (4847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120927.152992:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120927.155200:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922362496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120927.155236:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120927.155247:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120927.155320:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922362624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789120927.155374:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120927.155414:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdf780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120927.155617:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362624 00000100:00100000:3.0:1789120927.155623:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362624 00000100:00100000:3.0:1789120927.155669:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789120927.155677:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:14833:x1876028922362624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789120927.155695:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789120927.155710:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789120927.155713:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789120927.155790:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:14833:x1876028922362624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120927.155798:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120927.155926:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922362624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789120927.155981:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789120927.155988:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120927.155996:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120927.980937:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120929.002366:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120930.026605:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120931.050276:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789120931.059062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789120931.059069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789120931.059072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789120931.059075:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789120931.059133:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922362880:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.059335:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120931.059395:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120931.059401:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922362752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.059432:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120931.059469:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362880 00000100:00100000:0.0:1789120931.059475:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362880 00000100:00100000:0.0:1789120931.059512:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120931.059521:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922362880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.059567:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922362880:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120931.059575:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789120931.059612:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb98e8000 x1876028922362880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120931.059626:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922362880:0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.059728:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120931.059739:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922363008:0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.059773:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120931.059939:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363008 00000100:00100000:0.0:1789120931.059943:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363008 00000100:00100000:0.0:1789120931.059972:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120931.059978:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.060015:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876028922363008:12345-0@lo:400:kworker.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120931.060214:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922362752 00000100:00100000:1.0:1789120931.060219:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922362752 00000100:00100000:1.0:1789120931.060246:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789120931.060253:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3318:x1876028922362752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.060303:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3318:x1876028922362752:12345-0@lo:400:kworker.0 Request processed in 39us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120931.060309:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789120931.060360:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120931.060384:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922362752:0@lo:400:kworker.0 00010000:00080000:3.0:1789120931.061472:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb98e9e00 x1876028922363008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120931.061486:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876028922363008:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.061941:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789120932.074425:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120932.490992:0:15884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789120933.099887:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120934.130877:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.146243:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120936.170667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789120936.170675:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789120936.170678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789120936.170681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789120936.170733:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922363264:0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.170808:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.170887:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120936.170894:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922363392:0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.170919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.171126:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120936.171136:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922363136:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.171188:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.171235:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363264 00000100:00100000:0.0:1789120936.171240:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363264 00000100:00100000:0.0:1789120936.171287:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363392 00000100:00100000:0.0:1789120936.171301:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363392 00000100:00100000:0.0:1789120936.171328:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120936.171336:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922363264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.171381:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922363264:12345-0@lo:400:kworker.0 Request processed in 46us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.171388:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120936.171404:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120936.171410:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922363392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.171436:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922363392:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.171442:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120936.171473:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363136 00000100:00100000:0.0:1789120936.171476:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363136 00000100:00100000:0.0:1789120936.171516:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120936.171522:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3319:x1876028922363136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.171557:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3319:x1876028922363136:12345-0@lo:400:kworker.0 Request processed in 36us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.171563:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120936.171607:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922363136:0@lo:400:kworker.0 00000100:00080000:0.0:1789120936.171631:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789120936.171961:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb598cf00 x1876028922363392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120936.171973:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922363392:0@lo:400:kworker.0 00010000:00080000:1.0:1789120936.171982:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb598cb40 x1876028922363264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120936.171990:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922363264:0@lo:400:kworker.0 00010000:00010000:1.0:1789120936.173920:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789120936.494015:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789120937.196317:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.218385:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120938.794579:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120923/real 1789120923] req@ffff9ffdb54de940 x1876028922359168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120938 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120938.794619:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb54de940 x1876028922359168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120938 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120938.794630:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789120923/real 1789120923] req@ffff9ffdb54dcf00 x1876028922359296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120938 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120938.794642:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ffdb54dcf00 x1876028922359296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789120938 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789120938.794667:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd89879800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789120938.794700:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789120938.794706:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922359168:0@lo:8:kworker.0 00000100:00080000:2.0:1789120938.794712:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789120938.794718:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789120938.794721:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922359296:0@lo:8:kworker.0 00000100:00080000:3.0:1789120938.794862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120938.794868:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789120938.794871:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ffd89879800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120938.794877:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 390 00000100:00080000:3.0:1789120938.794903:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789120938.794912:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ffd89879800 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120938.794941:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dda40 x1876028922363648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789120938.794955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120938.794958:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789120938.794960:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120938.794964:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 390 00000100:00080000:3.0:1789120938.794967:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789120938.794971:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffdaf530000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120938.794982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54df480 x1876028922363776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120938.795041:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922364032:0@lo:400:kworker.0 00000100:00100000:3.0:1789120938.795128:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120938.795324:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922363520:0@lo:400:kworker.0 00000100:00100000:0.0:1789120938.795366:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120938.795451:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922363904:0@lo:400:kworker.0 00000100:00100000:2.0:1789120938.795484:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120938.795523:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922363648:0@lo:8:kworker.0 00000100:00100000:2.0:1789120938.795558:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120938.797290:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363648 00000100:00100000:1.0:1789120938.797307:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363648 00000100:00100000:1.0:1789120938.797363:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120938.797374:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876028922363648:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789120938.797413:0:15516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:1.0:1789120938.797467:0:15516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa5f2f 00002000:00100000:1.0:1789120938.797486:0:15516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ffdafde3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789120938.797490:0:15516:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789120938.797494:0:15516:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789120938.797897:0:15516:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120938.797933:0:15516:0:(import.c:65:import_set_state_nolock()) ffff9ffdafde5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120938.798037:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876028922363648:12345-0@lo:8:kworker.0 Request processed in 663us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120938.798046:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120938.800525:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364032 00000100:00100000:0.0:1789120938.800545:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364032 00000100:00080000:0.0:1789120938.801013:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120938.801080:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363904 00000100:00100000:0.0:1789120938.801086:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363904 00000100:00100000:0.0:1789120938.801114:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120938.801127:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922364032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120938.801286:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922364032:12345-0@lo:400:kworker.0 Request processed in 162us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120938.801294:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120938.801314:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120938.801321:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922363904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120938.801363:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876028922363904:12345-0@lo:400:kworker.0 Request processed in 42us (5877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120938.801370:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789120938.801476:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb54dfc00 x1876028922364032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120938.801496:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922364032:0@lo:400:kworker.0 00000100:00100000:1.0:1789120938.802535:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363520 00000100:00100000:1.0:1789120938.802548:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363520 00000100:00100000:1.0:1789120938.802603:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789120938.802613:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3319:x1876028922363520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120938.802745:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3319:x1876028922363520:12345-0@lo:400:kworker.0 Request processed in 133us (7377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120938.802754:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789120938.804936:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb54df840 x1876028922363904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120938.804972:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876028922363904:0@lo:400:kworker.0 00010000:00080000:1.0:1789120938.810318:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb54dda40 x1876028922363648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120938.810342:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120938.810356:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789120938.810368:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789120938.810376:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789120938.810380:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd89879800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789120938.810409:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789120938.810419:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922363648:0@lo:8:kworker.0 00000100:00100000:1.0:1789120938.810435:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922363776:0@lo:8:kworker.0 00000100:00100000:1.0:1789120938.810551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120938.810715:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922363520:0@lo:400:kworker.0 00000004:00080000:3.0:1789120938.811701:0:14858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789120938.811732:0:14858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14858:1876028922364288:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789120938.811796:0:14858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120938.811830:0:14858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd831e9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120938.811852:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922364160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120938.811893:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120938.811943:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922363776 00000100:00100000:3.0:1789120938.811951:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922363776 00000100:00100000:3.0:1789120938.811985:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364288 00000100:00100000:3.0:1789120938.811988:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364288 00000100:00100000:3.0:1789120938.812033:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120938.812041:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876028922363776:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789120938.812063:0:15516:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789120938.812109:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876028922363776:12345-0@lo:8:kworker.0 Request processed in 67us (1558us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789120938.812117:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120938.812135:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120938.812161:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14858:x1876028922364288:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1789120938.815839:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789120938.815857:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789120938.815863:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922363776:0@lo:8:kworker.0 00000004:00080000:1.0:1789120938.815935:0:14857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789120938.816270:0:14857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406070125649ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789120938.820278:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364160 00000100:00100000:1.0:1789120938.820300:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364160 00000100:00100000:1.0:1789120938.820370:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120938.820382:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1876028922364160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120938.820435:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120938.820550:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1876028922364160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (8656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120938.820558:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789120938.820628:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ffdb54de1c0 x1876028922364160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120938.820655:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922364160:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789120938.821329:0:15516:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789120938.821341:0:15516:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789120938.821348:0:15516:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:0.0:1789120938.822339:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789120938.830757:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.830776:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.830801:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.830807:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.830816:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.830836:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.830916:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.830926:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.830959:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789120938.831487:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.831495:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831504:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.831508:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.831512:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831523:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831531:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831539:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831573:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789120938.831592:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120938.831600:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831608:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120938.831613:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831625:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831645:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831654:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007582e977/0x13cfa3d77faa5f36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831676:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120938.831680:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831686:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120938.831689:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831709:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831721:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831728:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028be9d8e/0x13cfa3d77faa5f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.831742:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.831744:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.831746:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.832205:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.832212:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832223:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.832227:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.832232:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832243:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832262:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832276:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832292:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789120938.832321:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120938.832329:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.832338:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120938.832342:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.832351:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.832366:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.832373:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8e83f8/0x13cfa3d77faa5f44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.832390:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.832392:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.832394:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.832709:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.832715:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832724:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.832727:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.832731:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832742:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832749:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832757:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.832779:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.833224:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.833232:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.833242:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.833256:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.833265:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.833288:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.833295:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098581d65/0x13cfa3d77faa5f4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.833315:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.833317:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.833319:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.833557:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.833687:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.833694:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.833710:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.833713:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.833718:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.833728:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.833737:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.833744:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.833799:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789120938.834296:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.834303:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.834313:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.834317:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.834322:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.834331:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.834352:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.834359:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835477:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120938.835493:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835525:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120938.835531:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835542:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835561:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835570:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000326d47c7/0x13cfa3d77faa5f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835596:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120938.835601:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835608:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120938.835611:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835618:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835629:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.835645:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.835647:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.835649:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.835936:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789120938.835944:0:15516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a96aa0cc/0x13cfa3d77faa5f59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120938.836623:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.836630:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.836643:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.836648:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.836655:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.836669:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.836679:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.836697:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.836720:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120938.836910:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.836910:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120938.836917:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.836926:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120938.836931:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.836940:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.836954:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.836961:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006972ba33/0x13cfa3d77faa5f60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120938.836979:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.836981:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120938.836983:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.841766:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.841786:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.841809:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.841815:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.841823:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.841840:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.841852:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.841861:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.841888:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120938.841919:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.841928:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.841937:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.841943:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.841953:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.841979:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.841987:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863cb55f/0x13cfa3d77faa5f67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.842016:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.842018:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.842020:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.844420:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.844508:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.844602:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.844608:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.844616:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.844633:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.844645:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.844654:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.844684:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120938.844701:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.844709:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.844718:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.844730:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.844741:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.844759:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.844767:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ccb1dbd/0x13cfa3d77faa5f6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.844792:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.844793:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.844806:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.847388:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.847407:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.847723:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.847730:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.847738:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.847758:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.847785:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.847793:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.847821:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.847845:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.847853:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.847862:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ba00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.847867:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.847877:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.847898:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.847907:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048030e63/0x13cfa3d77faa5f75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.847941:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.847942:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.847944:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789120938.848358:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789120938.849497:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.849510:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.849596:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.849600:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.849607:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.849630:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.849640:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.849648:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.849685:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120938.849839:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.849848:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.849857:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.849862:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.849873:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.849890:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.849906:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fab4b68/0x13cfa3d77faa5f7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.849932:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.849934:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.849936:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.853227:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.853256:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.853278:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.853283:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.853291:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.853308:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.853321:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.853330:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.853358:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.853894:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.853905:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.853917:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.853922:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.853933:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.853954:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.853961:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a06d48f/0x13cfa3d77faa5f83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.853991:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.853993:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.853995:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.855643:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.855658:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.855677:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.855692:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.855700:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.855718:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.855728:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.855735:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.855881:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789120938.856500:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120938.856609:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.856620:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.856631:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390be00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.856636:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.856646:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.856666:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.856673:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4457934/0x13cfa3d77faa5f8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.856699:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.856701:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.856703:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.856763:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.856775:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.856779:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.856784:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.856795:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.856804:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.856819:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.856847:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789120938.858404:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.858418:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.858500:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.858505:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.858512:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.858595:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.858608:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.858617:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.858688:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789120938.859314:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.859323:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.859341:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.859345:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.859350:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.859362:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.859371:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.859380:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861420:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789120938.861442:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861463:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.861470:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861485:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861513:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861522:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013a836bb/0x13cfa3d77faa5f91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861548:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120938.861553:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861559:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390bc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.861563:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861570:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861599:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861608:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e25c8b54/0x13cfa3d77faa5f98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861626:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.861826:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861835:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390aa00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.861839:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861847:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861857:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.861866:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.861868:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.861870:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.862810:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789120938.862824:0:15516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5f9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120938.863763:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.863773:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.863790:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.863796:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.863804:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.863833:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.863845:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.863853:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.863866:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120938.864295:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.864303:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.864323:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.864328:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.864339:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.864356:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.864364:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042be28c9/0x13cfa3d77faa5fa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.864383:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.864385:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.864386:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.864680:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.864687:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.864697:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.864701:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.864705:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.864715:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.864724:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.864743:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.864806:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.869197:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.869217:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.869243:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.869257:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.869270:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.869298:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.869306:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf2f91f/0x13cfa3d77faa5fad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.869332:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.869334:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.869336:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.869524:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.871138:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.871170:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871193:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.871199:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.871207:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871224:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871236:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871244:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871282:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.871388:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.871396:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.871405:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.871410:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.871421:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.871592:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.871601:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042e47491/0x13cfa3d77faa5fb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.871629:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.871631:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.871633:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.871941:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.871947:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871963:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.871967:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.871971:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871980:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871989:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.871996:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872020:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.872065:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.872072:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872081:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390b400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.872085:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872094:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872106:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872114:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef06829/0x13cfa3d77faa5fbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872184:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.872186:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.872188:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.872483:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.872491:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872500:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.872503:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.872507:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872517:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872539:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872546:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.872568:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.872595:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.872600:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872608:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390ae00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.872612:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872621:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872632:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872640:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4664c8/0x13cfa3d77faa5fc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.872653:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.872655:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.872657:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.872985:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.872991:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873000:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.873003:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.873007:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873015:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873024:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873032:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873066:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.873133:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.873138:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.873180:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.873183:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.873191:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.873203:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.873211:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002fda6dd/0x13cfa3d77faa5fc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.873226:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.873228:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.873229:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.873519:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.873525:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873535:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.873538:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.873542:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873552:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873560:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873568:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.873589:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.874083:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.874092:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.874102:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390a800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.874106:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.874115:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.874611:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.874620:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c666156e/0x13cfa3d77faa5fd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.874645:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.874647:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.874650:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.878681:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.878698:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.878718:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.878733:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.878741:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.878760:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.878772:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.878781:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.878809:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120938.878837:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120938.878846:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.878855:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8390aa00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120938.878860:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.878871:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.878892:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.878901:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062cb73ad/0x13cfa3d77faa5fd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.878935:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.878937:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120938.878940:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789120938.879594:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.879604:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.879615:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.879619:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.879623:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.879634:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.879642:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.879657:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.879722:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789120938.880213:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789120938.880220:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.880231:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1789120938.880234:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120938.880239:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.880524:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.880537:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.880544:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882534:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120938.882552:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882568:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149bc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.882574:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882602:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882825:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882834:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078494260/0x13cfa3d77faa5fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882865:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120938.882869:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882875:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149b800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120938.882878:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882886:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882896:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.882904:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.882906:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120938.882915:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.883062:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789120938.883072:0:15516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e77bf3/0x13cfa3d77faa5fe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120938.883531:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789120938.886013:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789120938.886027:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.886048:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1789120938.886054:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120938.886062:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.886078:0:15516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.886089:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.886097:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120938.886131:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789120938.886179:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120938.886187:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.886195:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120938.886199:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.886209:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.886228:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.886235:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18b68fe/0x13cfa3d77faa5fec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120938.886265:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.886267:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120938.886269:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789120938.886490:0:15516:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789120938.886773:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14858:x1876028922364288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74625us (74970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120938.886786:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120938.886993:0:14858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14858:1876028922364288:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789120938.887014:0:14858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789120938.887072:0:14858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14858:1876028922364416:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789120938.887115:0:14858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120938.887197:0:14858:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd831e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120938.887481:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364416 00000100:00100000:1.0:1789120938.887490:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364416 00000100:00100000:1.0:1789120938.887551:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120938.887561:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14858:x1876028922364416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789120938.887612:0:15518:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789120938.902980:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14858:x1876028922364416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15410us (15854us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789120938.903001:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120938.903055:0:14858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dfc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14858:1876028922364416:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789120938.903078:0:14858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789120939.245397:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789120940.164972:0:16235:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789120940.164976:0:16235:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789120940.165113:0:16235:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ffd85287800 00000020:01000004:3.0:1789120940.165131:0:16235:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789120940.165159:0:16235:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789120940.165174:0:16235:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ffd955d1a48) 00000020:00000080:3.0:1789120940.165189:0:16235:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789120940.183745:0:16235:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789120940.184004:0:16235:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789120940.185025:0:16235:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789120940.185445:0:16235:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789120940.185655:0:16235:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789120940.186233:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 302: rc = 0 00100000:10000000:3.0:1789120940.186470:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 302: rc = 0 00100000:10000000:3.0:1789120940.186563:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 302: rc = 0 00100000:10000000:3.0:1789120940.188338:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1789120940.188760:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1789120940.189105:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 643: rc = 0 00100000:10000000:3.0:1789120940.189537:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1789120940.189882:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 643: rc = 0 00100000:10000000:3.0:1789120940.190125:0:16235:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 643: rc = 0 00000020:00000080:3.0:1789120940.192323:0:16235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789120940.192336:0:16235:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789120940.192347:0:16235:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x13cfa3d77faa5ffa 00000020:01000004:3.0:1789120940.192417:0:16235:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789120940.192443:0:16235:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789120940.192446:0:16235:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789120940.192452:0:16235:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789120940.192472:0:16235:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789120940.192476:0:16235:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789120940.201908:0:16235:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789120940.201946:0:16235:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.109@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789120940.201951:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789120940.201952:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789120940.201954:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120940.201955:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120940.201956:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120940.201958:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120940.201959:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120940.201961:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120940.201962:0:16235:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120940.201966:0:16235:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789120940.201968:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120940.201970:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789120940.201971:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120940.201972:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120940.201973:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120940.201974:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120940.201975:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120940.201976:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120940.201977:0:16235:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120940.202003:0:16235:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789120940.202021:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789120940.202105:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120940.202559:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364544 00000100:00100000:0.0:1789120940.202566:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364544 00000100:00100000:0.0:1789120940.202620:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120940.202629:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:16235:x1876028922364544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789120940.202659:0:14830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789120940.202662:0:14830:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789120940.202666:0:14830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789120940.212506:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd831e9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789120940.213191:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:16235:x1876028922364544:12345-0@lo:253:mount.lustre.0 Request processed in 10558us (11081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.213203:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789120940.213340:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789120940.213479:0:16235:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789120940.213483:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789120940.213485:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789120940.213487:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120940.213488:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120940.213489:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120940.213490:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120940.213492:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120940.213494:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120940.213495:0:16235:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789120940.213523:0:16235:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ffd85287800 from lustre-OST0001 10000000:01000000:2.0:1789120940.213548:0:16235:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789120940.213550:0:16235:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789120940.213557:0:16235:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ffdb57bced8 local copy 00010000:00010000:2.0:1789120940.213567:0:16235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120940.213939:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120940.214059:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.214186:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfb4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.214287:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364672 00000100:00100000:0.0:1789120940.214294:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364672 00000100:00100000:0.0:1789120940.214515:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120940.214526:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:16235:x1876028922364672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120940.214730:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:16235:x1876028922364672:12345-0@lo:501:mount.lustre.0 Request processed in 205us (669us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120940.214738:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789120940.214822:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364672:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789120940.214838:0:16235:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789120940.215001:0:16235:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789120940.215009:0:16235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.215030:0:16235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4b800/0x13cfa3d77faa5da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa5dae expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120940.215049:0:16235:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ffd85287800 10000000:01000000:2.0:1789120940.215053:0:16235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789120940.215058:0:16235:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789120940.215060:0:16235:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120940.215064:0:16235:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789120940.215067:0:16235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789120940.215091:0:16235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.215097:0:16235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.215105:0:16235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120940.215120:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789120940.215165:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.215721:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfb4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.216085:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364800 00000100:00100000:1.0:1789120940.216093:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364800 00000100:00100000:1.0:1789120940.216132:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789120940.216140:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:16235:x1876028922364800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120940.216170:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120940.216184:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bac00/0x13cfa3d77faa6008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa6001 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.216207:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bac00/0x13cfa3d77faa6008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa6001 expref: 17 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.216217:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bac00/0x13cfa3d77faa6008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa6001 expref: 17 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.216226:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bac00, rc 0) 00000100:00100000:1.0:1789120940.216325:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922364800:12345-0@lo:101:mount.lustre.0 Request processed in 186us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.216333:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789120940.216637:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789120940.216655:0:16235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6008 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.216665:0:16235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa6008 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120940.219046:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789120940.220918:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120940.221612:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789120940.221658:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789120940.221891:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789120940.221944:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789120940.222485:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789120940.222538:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789120940.222620:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789120940.222768:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789120940.222938:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120940.223075:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.223247:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd88edf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.223307:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922364928 00000100:00100000:1.0:1789120940.223313:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922364928 00000100:00100000:1.0:1789120940.223470:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789120940.223480:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922364928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120940.223938:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922364928:12345-0@lo:501:mount.lustre.0 Request processed in 460us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.223953:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120940.224081:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922364928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120940.224114:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120940.224181:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.224525:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd88edf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.224574:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365056 00000100:00100000:0.0:1789120940.224579:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365056 00000100:00100000:0.0:1789120940.224604:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789120940.224610:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120940.225263:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365056:12345-0@lo:503:mount.lustre.0 Request processed in 651us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120940.225272:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789120940.225509:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789120940.226591:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789120940.226743:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120940.226879:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.226923:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc82e99e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.227009:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365184 00000100:00100000:0.0:1789120940.227017:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365184 00000100:00100000:0.0:1789120940.227049:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120940.227057:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120940.227318:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365184:12345-0@lo:502:mount.lustre.0 Request processed in 261us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120940.227342:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789120940.227718:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789120940.228180:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789120940.228235:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789120940.228291:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789120940.228385:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789120940.228426:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789120940.228461:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789120940.228505:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789120940.228535:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789120940.228575:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789120940.228607:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120940.228659:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.228987:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd88edf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.229129:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365312 00000100:00100000:1.0:1789120940.229136:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365312 00000100:00100000:3.0:1789120940.229503:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789120940.229514:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789120940.229842:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365312:12345-0@lo:502:mount.lustre.0 Request processed in 330us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.229850:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789120940.230176:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789120940.230282:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789120940.230294:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789120940.232129:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120940.232140:0:16237:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789120940.232166:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.232169:0:16237:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789120940.232175:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120940.232190:0:16237:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ffd9cd1ced8) 00000020:00000080:0.0:1789120940.232213:0:16237:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789120940.232218:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789120940.232287:0:16237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffd85287800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789120940.232296:0:16237:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789120940.232302:0:16237:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x13cfa3d77faa6016 00010000:00010000:0.0:1789120940.238565:0:16237:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789120940.241054:0:16237:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789120940.245107:0:16237:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1789120940.248219:0:16237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789120940.248233:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120940.248588:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.248591:0:16237:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789120940.248597:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120940.248603:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.248604:0:16237:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789120940.248608:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789120940.248610:0:16237:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789120940.248613:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120940.248615:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.248617:0:16237:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789120940.248619:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120940.248621:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.248623:0:16237:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789120940.248626:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789120940.248668:0:16237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120940.248762:0:16237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120940.248763:0:16237:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789120940.248768:0:16237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789120940.249087:0:16235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789120940.249111:0:16235:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789120940.249134:0:16235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6008 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120940.249176:0:16235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56a00/0x13cfa3d77faa6001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6008 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120940.249185:0:16235:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 1 10000000:01000000:3.0:1789120940.249188:0:16235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120940.249221:0:16235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120940.249229:0:16235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120940.249559:0:16235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120940.249585:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789120940.249642:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.249776:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365440 00000100:00100000:1.0:1789120940.249782:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365440 00000100:00100000:1.0:1789120940.249836:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789120940.249845:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:16235:x1876028922365440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120940.249857:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120940.249872:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa601d expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.249893:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.249903:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.249912:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bba00, rc 0) 00000100:00100000:1.0:1789120940.249946:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365440:12345-0@lo:101:mount.lustre.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.249952:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789120940.250161:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3001900 going to sleep for 11 seconds 00000100:00100000:3.0:1789120940.250183:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789120940.250198:0:16235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120940.250222:0:16235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120940.251228:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789120940.256090:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120940.257559:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789120940.257619:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789120940.258037:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789120940.258047:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789120940.258140:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789120940.258222:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120940.262505:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3001900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.269803:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365568 00000100:00100000:1.0:1789120940.269815:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365568 00000100:00100000:1.0:1789120940.269876:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120940.269886:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120940.270314:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365568:12345-0@lo:501:mount.lustre.0 Request processed in 428us (12090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.270322:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789120940.272227:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120940.272296:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789120940.272374:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.272416:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd831ff540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.272580:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365696 00000100:00100000:0.0:1789120940.272586:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365696 00000100:00100000:0.0:1789120940.272636:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120940.272646:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120940.272992:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365696:12345-0@lo:503:mount.lustre.0 Request processed in 347us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120940.273000:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1789120940.273913:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120940.274776:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365696:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789120940.276812:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789120940.276904:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789120940.277048:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.277169:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8facecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120940.277511:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365824 00000100:00100000:2.0:1789120940.277518:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365824 00000100:00100000:2.0:1789120940.277594:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789120940.277605:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789120940.277820:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365824:12345-0@lo:502:mount.lustre.0 Request processed in 217us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120940.277828:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789120940.277904:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789120940.278251:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789120940.278301:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789120940.278372:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789120940.278412:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789120940.278448:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789120940.278497:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789120940.278536:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789120940.278584:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789120940.278630:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789120940.278663:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789120940.278709:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789120940.278744:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789120940.278793:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.279986:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8facecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.280087:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922365952 00000100:00100000:0.0:1789120940.280095:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922365952 00000100:00100000:0.0:1789120940.280266:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120940.280276:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120940.280616:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922365952:12345-0@lo:502:mount.lustre.0 Request processed in 340us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120940.280623:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789120940.280873:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922365952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789120940.281039:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789120940.281053:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789120940.284347:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120940.284368:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.284371:0:16242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789120940.284380:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd85287800 00000020:00000080:3.0:1789120940.284383:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120940.284392:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120940.284395:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.284396:0:16242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789120940.284399:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120940.284401:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.284402:0:16242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120940.284405:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ffd85287800 00000020:00000080:3.0:1789120940.284408:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120940.285920:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120940.285929:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.285931:0:16242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789120940.285936:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120940.285954:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.285956:0:16242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120940.285961:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd85287800 00000020:00000080:3.0:1789120940.285965:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120940.288011:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120940.288029:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.288031:0:16242:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120940.288036:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120940.288040:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.288041:0:16242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789120940.288046:0:16242:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ffd85287800 00000020:00000080:3.0:1789120940.288048:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120940.288489:0:16242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120940.288494:0:16242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120940.288496:0:16242:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789120940.288500:0:16242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789120940.288741:0:16235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789120940.288777:0:16235:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120940.288836:0:16235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.288873:0:16235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120940.288931:0:16235:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789120940.288934:0:16235:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ffd85287800 10000000:01000000:1.0:1789120940.288938:0:16235:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ffd85287800 10000000:01000000:1.0:1789120940.288942:0:16235:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789120940.288949:0:16235:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ffd85287800 from 1 10000000:01000000:1.0:1789120940.288951:0:16235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789120940.288998:0:16235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.289006:0:16235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.289018:0:16235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120940.289049:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789120940.289136:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.289592:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8face180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.289913:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366080 00000100:00100000:0.0:1789120940.289921:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366080 00000100:00100000:0.0:1789120940.289974:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789120940.289985:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922366080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789120940.290003:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120940.290025:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa6032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa602b expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120940.290055:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa6032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa602b expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120940.290068:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4bc00/0x13cfa3d77faa6032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa602b expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120940.290085:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4bc00, rc 0) 00000100:00100000:0.0:1789120940.291709:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366080:12345-0@lo:101:mount.lustre.0 Request processed in 1714us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120940.291725:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789120940.302989:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789120940.303032:0:16235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6032 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.303050:0:16235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa6032 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120940.306220:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789120940.307658:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120940.308079:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789120940.308137:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789120940.308201:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789120940.308270:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789120940.308311:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789120940.308364:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789120940.308403:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789120940.312648:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789120940.313310:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789120940.313362:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789120940.314366:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789120940.314641:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789120940.314685:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789120940.314736:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789120940.316643:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789120940.316765:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789120940.317029:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789120940.317108:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789120940.317174:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789120940.317214:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789120940.317280:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789120940.317318:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789120940.317354:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789120940.317407:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789120940.317471:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789120940.319766:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789120940.320770:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789120940.321117:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789120940.321192:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789120940.321277:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789120940.321318:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789120940.321352:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789120940.321390:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789120940.321440:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789120940.321482:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789120940.322729:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789120940.322778:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789120940.322967:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789120940.322975:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789120940.323121:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789120940.323727:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.324122:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366208 00000100:00100000:2.0:1789120940.324132:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366208 00000100:00100000:1.0:1789120940.324226:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8face180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120940.328767:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120940.328798:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789120940.329225:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366208:12345-0@lo:501:mount.lustre.0 Request processed in 441us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120940.329236:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789120940.331483:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789120940.331562:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789120940.331644:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.337448:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366336 00000100:00100000:1.0:1789120940.337469:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366336 00000100:00100000:1.0:1789120940.337587:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789120940.337598:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789120940.339171:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366336:12345-0@lo:503:mount.lustre.0 Request processed in 1544us (7496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.339189:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120940.340770:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd889ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120940.340820:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789120940.342754:0:16235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789120940.342874:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120940.342977:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120940.343038:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd889ce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.343175:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366464 00000100:00100000:1.0:1789120940.343184:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366464 00000100:00100000:1.0:1789120940.343249:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789120940.343259:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789120940.343532:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366464:12345-0@lo:502:mount.lustre.0 Request processed in 274us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.343541:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120940.344369:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789120940.344740:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789120940.344840:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789120940.344888:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789120940.344957:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789120940.344998:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789120940.345061:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789120940.345104:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789120940.345140:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789120940.345226:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789120940.345280:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789120940.345319:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789120940.345385:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789120940.345423:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789120940.345455:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789120940.345499:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789120940.345530:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789120940.345561:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789120940.345628:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789120940.345667:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789120940.345699:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789120940.345748:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789120940.345782:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789120940.345817:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789120940.345874:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789120940.345920:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789120940.345957:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789120940.346008:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789120940.346045:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789120940.346081:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789120940.346133:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789120940.346518:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789120940.346568:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789120940.346598:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789120940.346653:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789120940.346721:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789120940.347193:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789120940.347234:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789120940.347394:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789120940.347460:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789120940.347503:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789120940.347574:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120940.347675:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.347883:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366592 00000100:00100000:1.0:1789120940.347892:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366592 00000100:00100000:1.0:1789120940.347944:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789120940.347953:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789120940.348129:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd889ce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120940.348260:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922366592:12345-0@lo:502:mount.lustre.0 Request processed in 306us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.348269:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120940.348919:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922366592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789120940.349026:0:16235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789120940.349040:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789120940.352497:0:16248:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789120940.352521:0:16248:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ffdb9aa1a48) 00000020:00000080:1.0:1789120940.352550:0:16248:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789120940.352653:0:16248:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ffd85287800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789120940.352659:0:16248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ffd85287800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789120940.352662:0:16248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ffd85287800 3 00010000:00080000:1.0:1789120940.352699:0:16248:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ffd82aa5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.109@tcp at head 00010000:00010000:0.0:1789120940.357067:0:16248:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789120940.357403:0:16248:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789120940.357461:0:16248:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789120940.357486:0:16248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x13cfa3d77faa6040 00000100:00080000:0.0:1789120940.357501:0:16248:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120940.357509:0:16248:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ffd82aa5000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789120940.357557:0:16248:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb98e8000 x1876028922366720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789120940.357594:0:16248:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789120940.358292:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922366720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789120940.358410:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789120940.358668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789120940.358674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789120940.358677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789120940.358683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1789120940.358689:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789120940.358695:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffdaf530000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:3.0:1789120940.358716:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb54dde00 x1876028922366976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120940.358776:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922366848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.358815:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120940.358847:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120940.358854:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922367104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.358881:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120940.358913:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922367232:0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.358939:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120940.358985:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366720 00000100:00100000:3.0:1789120940.358995:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366720 00000100:00100000:3.0:1789120940.359025:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367104 00000100:00100000:3.0:1789120940.359028:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367104 00000100:00100000:3.0:1789120940.359053:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367232 00000100:00100000:3.0:1789120940.359056:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367232 00000100:00100000:3.0:1789120940.359091:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120940.359101:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922367104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120940.359277:0:14835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120940.359287:0:14835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789120940.359316:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366848 00000100:00100000:1.0:1789120940.359321:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366848 00000100:00100000:1.0:1789120940.359358:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120940.359367:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1876028922366848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120940.359436:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1876028922366848:12345-0@lo:400:kworker.0 Request processed in 70us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120940.359444:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120940.359846:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922367104:12345-0@lo:400:kworker.0 Request processed in 744us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.359853:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120940.359871:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120940.359878:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922367232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.359912:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876028922367232:12345-0@lo:400:kworker.0 Request processed in 36us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.359918:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120940.359929:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120940.359933:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1876028922366720:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789120940.359958:0:14836:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:3.0:1789120940.360000:0:14836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x13cfa3d77faa6047 00000004:00100000:3.0:1789120940.360018:0:14836:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789120940.360053:0:14836:0:(import.c:65:import_set_state_nolock()) ffff9ffc83333000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120940.360094:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876028922366720:12345-0@lo:38:llog_process_th.0 Request processed in 159us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.360101:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789120940.360124:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120940.360128:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120940.361516:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54de580 x1876028922367104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120940.361538:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922367104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.361560:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922366848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120940.361612:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922366976:0@lo:8:kworker.0 00000100:00100000:3.0:1789120940.361685:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789120940.361746:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb98e8000 x1876028922366720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120940.361756:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120940.361766:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789120940.361778:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789120940.361784:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120940.361788:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffd82aa5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120940.361796:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876028922366720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789120940.361806:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922366976 00000100:00100000:2.0:1789120940.361816:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922366976 00000100:00100000:2.0:1789120940.361869:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120940.361878:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3316:x1876028922366976:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789120940.362034:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3316:x1876028922366976:12345-0@lo:8:kworker.0 Request processed in 154us (348us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789120940.362040:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120940.362046:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789120940.362054:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789120940.362058:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120940.362060:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922366976:0@lo:8:kworker.0 00010000:00080000:1.0:1789120940.362200:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54dcb40 x1876028922367232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120940.362212:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876028922367232:0@lo:400:kworker.0 00000040:00080000:3.0:1789120940.364031:0:16248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789120940.364133:0:16235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789120940.364188:0:16235:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789120940.364208:0:16235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6032 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.364221:0:16235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba600/0x13cfa3d77faa602b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa6032 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789120940.364285:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789120940.364288:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789120940.364290:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120940.364291:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120940.364292:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120940.364294:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120940.364295:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120940.364298:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120940.364299:0:16235:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789120940.364304:0:16235:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789120940.364306:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789120940.364308:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789120940.364309:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120940.364316:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120940.364316:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120940.364317:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120940.364318:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120940.364319:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120940.364320:0:16235:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789120940.364352:0:16235:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789120940.364374:0:16235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc834621c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922367360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789120940.364454:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.364523:0:16235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffdbfbdfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120940.364549:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367360 00000100:00100000:2.0:1789120940.364556:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367360 00000100:00100000:2.0:1789120940.364606:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789120940.364618:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:16235:x1876028922367360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789120940.364653:0:14828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789120940.364672:0:14828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789120940.428305:0:14828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789120940.428329:0:14828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789120940.428945:0:14851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789120940.428952:0:14851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789120940.428980:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.429001:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.429011:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.429064:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.429082:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 19 pid: 14829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120940.429099:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922367488:0@lo:104: 00000100:00100000:1.0:1789120940.429342:0:14851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120940.429444:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8facee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120940.429501:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367488 00000100:00100000:2.0:1789120940.429563:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367488 00000100:00100000:2.0:1789120940.429718:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120940.429851:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922367488:12345-0@lo:104: 00010000:00010000:2.0:1789120940.429869:0:14819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.429940:0:14819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120940.429946:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:14851:x1876028922367488:12345-0@lo:104: Request processed in 220us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120940.429955:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120940.430052:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14851:1876028922367488:0@lo:104: 00010000:00010000:1.0:1789120940.430076:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.430140:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120940.430375:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.430401:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba200 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:2.0:1789120940.430410:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.430419:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120940.430428:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120940.430434:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120940.430595:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.430603:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120940.430638:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120940.430643:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789120940.430645:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba200/0x13cfa3d77faa5f21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5f28 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120940.430660:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc834630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922367616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120940.430664:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120940.430666:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120940.430667:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120940.430709:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120940.430889:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367616 00000100:00100000:2.0:1789120940.430895:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367616 00010000:00010000:2.0:1789120940.430918:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 20 pid: 14829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120940.430955:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120940.430969:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+20:3317:x1876028922367616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120940.430982:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120940.430988:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 20 pid: 14829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.430999:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 20 pid: 14829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431015:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81691000/0x13cfa3d77faa5f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5f21 expref: 20 pid: 14829 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431030:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431040:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789120940.431054:0:14820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002105661s 00010000:00010000:2.0:1789120940.431060:0:14820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431067:0:14820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431074:0:14820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431080:0:14820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431086:0:14820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120940.431096:0:14820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431106:0:14820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431119:0:14820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120940.431129:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120940.431222:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3317:x1876028922367616:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120940.431336:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc834630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922367616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120940.431449:0:14851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.431469:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120940.431475:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bbc00/0x13cfa3d77faa604e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120940.431727:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120940.439162:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:16235:x1876028922367360:12345-0@lo:253:mount.lustre.0 Request processed in 74517us (74677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120940.439181:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789120940.439380:0:16235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc834621c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:663c5952-eef7-4d23-9f6d-c418f8c48dc5:16235:1876028922367360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789120940.439401:0:16235:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789120940.439405:0:16235:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120940.439407:0:16235:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789120940.439408:0:16235:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120940.439409:0:16235:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120940.439411:0:16235:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120940.439412:0:16235:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120940.439414:0:16235:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789120940.439416:0:16235:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120940.439418:0:16235:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789120940.439436:0:16235:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789120940.451761:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789120940.451996:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789120940.454079:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120940.456923:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789120940.460472:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789120940.462028:0:16235:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789120940.473070:0:16235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789120940.558061:0:16235:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789120940.558071:0:16235:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789120940.558102:0:16235:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789120940.558527:0:16235:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789120940.558541:0:16235:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789120940.558572:0:16235:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789120941.296575:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789120941.389832:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789120941.389857:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:3.0:1789120941.931213:0:14833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789120941.931222:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ffd82c7a800 from 8 10000000:01000000:3.0:1789120941.931237:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789120941.931308:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120941.931323:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120941.931336:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120941.931371:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922367744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120941.931460:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120941.931531:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120941.931707:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367744 00000100:00100000:1.0:1789120941.931716:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367744 00000100:00100000:1.0:1789120941.931786:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789120941.931797:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922367744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120941.931813:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120941.931830:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb400/0x13cfa3d77faa605c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa6055 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120941.931858:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb400/0x13cfa3d77faa605c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa6055 expref: 19 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120941.931884:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bb400/0x13cfa3d77faa605c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa6055 expref: 19 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120941.931895:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb400, rc 0) 00000100:00100000:1.0:1789120941.931943:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922367744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120941.931951:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789120941.932057:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922367744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120941.932075:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa605c expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120941.932084:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa605c expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120941.932176:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922367872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789120941.932214:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120941.932253:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120941.932329:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922367872 00000100:00100000:1.0:1789120941.932334:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922367872 00000100:00100000:1.0:1789120941.932369:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789120941.932376:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922367872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789120941.932392:0:14828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789120941.932411:0:14828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789120941.932414:0:14828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789120941.932500:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922367872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120941.932507:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789120941.935649:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922367872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789120941.935762:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789120941.935775:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa605c expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120941.935787:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149ac00/0x13cfa3d77faa6055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa605c expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120942.321692:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120943.342216:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120943.850567:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922368000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120943.850680:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120943.851034:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368000 00000100:00100000:3.0:1789120943.851044:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368000 00000100:00100000:3.0:1789120943.851126:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120943.851137:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922368000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120943.851349:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120943.851420:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922368000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 286us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120943.851429:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120943.851479:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789120943.851505:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922368000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789120943.851709:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789120944.362530:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120945.388394:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789120945.388402:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1789120945.388403:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789120945.388406:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789120945.388418:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ffdaf530000 using connection 192.168.206.109@tcp/0@lo 00000100:00100000:0.0:1789120945.388425:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922368128:0@lo:400:kworker.0 00000100:00100000:1.0:1789120945.388445:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ffdb598e1c0 x1876028922368384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120945.388507:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120945.388522:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922368512:0@lo:400:kworker.0 00000100:00100000:1.0:1789120945.388563:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120945.388577:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922368640:0@lo:400:kworker.0 00000100:00100000:1.0:1789120945.388590:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120945.388598:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922368256:0@lo:400:kworker.0 00000100:00100000:0.0:1789120945.388614:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120945.388633:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120945.388682:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368256 00000100:00100000:1.0:1789120945.388690:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368256 00000100:00100000:1.0:1789120945.388751:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120945.388761:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922368256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120945.388800:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120945.388809:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922368768:0@lo:400:kworker.0 00000100:00100000:1.0:1789120945.388822:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922368256:12345-0@lo:400:kworker.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120945.388830:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120945.388846:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120945.388856:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120945.388887:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922368256:0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389261:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922368384:0@lo:8:kworker.0 00000100:00100000:3.0:1789120945.389294:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120945.389343:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368128 00000100:00100000:3.0:1789120945.389348:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368128 00000100:00100000:3.0:1789120945.389385:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120945.389393:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3319:x1876028922368128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389436:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3319:x1876028922368128:12345-0@lo:400:kworker.0 Request processed in 42us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120945.389457:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120945.389488:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368512 00000100:00100000:3.0:1789120945.389492:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368512 00000100:00100000:3.0:1789120945.389521:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368640 00000100:00100000:3.0:1789120945.389524:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368640 00000100:00100000:3.0:1789120945.389544:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368768 00000100:00100000:3.0:1789120945.389547:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368768 00000100:00100000:3.0:1789120945.389560:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120945.389566:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922368512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389600:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922368512:12345-0@lo:400:kworker.0 Request processed in 34us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120945.389606:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120945.389617:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789120945.389623:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922368640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389662:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922368640:12345-0@lo:400:kworker.0 Request processed in 39us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120945.389668:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789120945.389679:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789120945.389684:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922368768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389711:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922368768:12345-0@lo:400:kworker.0 Request processed in 27us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120945.389725:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789120945.389746:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120945.389766:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb598e940 x1876028922368512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120945.389777:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922368512:0@lo:400:kworker.0 00010000:00080000:3.0:1789120945.389801:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb598c3c0 x1876028922368768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120945.389811:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922368768:0@lo:400:kworker.0 00010000:00080000:3.0:1789120945.389820:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb598f840 x1876028922368640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120945.389827:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922368640:0@lo:400:kworker.0 00000100:00100000:3.0:1789120945.389836:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922368128:0@lo:400:kworker.0 00000100:00100000:1.0:1789120945.390171:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368384 00000100:00100000:1.0:1789120945.390176:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368384 00000100:00100000:1.0:1789120945.390219:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120945.390224:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876028922368384:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789120945.390248:0:15516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1789120945.390274:0:15516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x13cfa3d77faa6063 00002000:00100000:1.0:1789120945.390286:0:15516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ffdaf531000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789120945.390290:0:15516:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789120945.390293:0:15516:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789120945.390595:0:15516:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789120945.390619:0:15516:0:(import.c:65:import_set_state_nolock()) ffff9ffdaa069800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120945.390690:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876028922368384:12345-0@lo:8:kworker.0 Request processed in 465us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120945.390697:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789120945.391327:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb598e1c0 x1876028922368384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789120945.391343:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789120945.391351:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789120945.391357:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789120945.391360:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9ffdaf530000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789120945.391373:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789120945.391378:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876028922368384:0@lo:8:kworker.0 00000004:00080000:3.0:1789120945.391438:0:14860:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00010000:00010000:0.0:1789120945.391521:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120945.391575:0:14860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14860:1876028922369024:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789120945.391626:0:14860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120945.391735:0:14860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a2f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120945.391751:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922368896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120945.391774:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120945.391803:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922368896 00000100:00100000:3.0:1789120945.391808:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922368896 00000100:00100000:3.0:1789120945.391846:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120945.391854:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922368896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120945.391879:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120945.391916:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876028922368896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120945.391923:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789120945.391942:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120945.391957:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ffdb54de580 x1876028922368896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120945.391971:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922368896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120945.392004:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369024 00000100:00100000:3.0:1789120945.392008:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369024 00000100:00100000:3.0:1789120945.392031:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120945.392037:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14860:x1876028922369024:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789120945.393346:0:14859:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789120945.393824:0:14859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412647678942ns, next at 0ns, rc = 0 00002000:00080000:2.0:1789120945.403803:0:15517:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789120945.403814:0:15517:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789120945.403820:0:15517:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1789120945.423716:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.423731:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423753:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.423770:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.423777:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423796:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423807:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423815:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423835:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.423847:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.423853:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423862:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.423866:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423875:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423903:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423912:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e64f745c/0x13cfa3d77faa606a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.423932:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.423934:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.423936:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.424415:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.424422:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424429:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.424432:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.424436:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424445:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424452:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424459:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424483:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.424492:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.424496:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424503:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.424507:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424515:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424527:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424535:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa6071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424547:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.424549:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.424551:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.424943:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.424949:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424958:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.424966:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.424971:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424982:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424989:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.424996:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425009:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.425018:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.425022:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425029:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.425032:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425040:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425051:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425070:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425083:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.425085:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.425086:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.425497:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.425504:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425512:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.425516:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.425520:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425529:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425537:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425544:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425558:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.425567:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.425576:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425583:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.425586:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425593:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425604:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425611:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cb12e75/0x13cfa3d77faa607f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.425625:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.425627:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.425629:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.426356:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.426365:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426374:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.426378:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.426381:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426401:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426408:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426415:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426429:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.426438:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.426442:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426450:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.426453:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426462:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426473:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426481:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e24146/0x13cfa3d77faa6086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426502:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.426504:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.426506:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.426847:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.426853:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426860:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.426863:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.426867:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426875:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426882:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426889:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426903:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.426910:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.426914:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426931:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.426934:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426942:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426953:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426960:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588dcea8/0x13cfa3d77faa608d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.426974:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.426976:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.426978:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.427362:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.427368:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427376:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.427379:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.427383:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427391:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427405:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427411:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427425:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.427432:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.427436:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427443:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.427446:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427454:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427464:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427471:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f824437/0x13cfa3d77faa6094 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427486:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.427493:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.427494:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.427831:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.427837:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427845:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.427848:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.427852:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427861:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427868:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427874:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427886:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.427894:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.427897:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427903:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.427906:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427925:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427935:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427942:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fabdeae/0x13cfa3d77faa609b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.427955:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.427957:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.427959:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.428347:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.428353:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428363:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.428367:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.428371:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428381:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428389:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428403:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428417:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.428425:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.428429:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428437:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.428440:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428448:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428459:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428466:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3a0f069/0x13cfa3d77faa60a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.428480:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.428482:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.428484:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.428847:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.428859:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120945.432567:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789120945.435744:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.435749:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.435767:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435783:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435794:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435801:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435830:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.435842:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.435847:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435853:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.435858:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435867:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435888:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435896:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa60a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.435923:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.435925:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.435926:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.437162:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.437172:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437183:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.437186:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.437191:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437202:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437223:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437231:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437261:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.437272:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.437277:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437283:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.437287:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437295:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437308:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437315:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1314463/0x13cfa3d77faa60b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.437333:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.437335:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.437337:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.438434:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.438442:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438453:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.438462:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.438467:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438477:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438484:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438491:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438507:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.438518:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.438522:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438530:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.438533:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438541:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438554:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438573:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008910511a/0x13cfa3d77faa60b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.438590:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.438592:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.438594:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.439205:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.439222:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439230:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.439234:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.439238:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439248:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439257:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439264:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439329:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789120945.439696:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.439707:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439716:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.439719:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.439723:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439731:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439739:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.439746:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439837:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120945.439845:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439853:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.439862:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439870:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439887:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439893:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2983d0/0x13cfa3d77faa60be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439910:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.439913:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439918:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.439921:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439927:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439935:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.439941:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.439947:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.439949:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.440017:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.440022:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0174a15/0x13cfa3d77faa60c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.440467:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.440473:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.440481:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.440484:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.440494:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.440503:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.440510:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.440517:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.440873:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.440879:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.440893:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.440897:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.440907:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.440921:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.440929:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.440931:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.440933:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.440990:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.440995:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3d0a6e/0x13cfa3d77faa60cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.441460:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.441467:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.441477:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.441480:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.441485:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.441495:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.441515:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.441523:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.441570:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.441575:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.441582:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.441585:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.441593:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.441611:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.441619:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.441621:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.441623:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.441683:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.441687:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eac3df0/0x13cfa3d77faa60d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.442098:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.442111:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.442119:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.442122:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.442126:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.442136:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.442159:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.442176:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.442299:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.442305:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.442313:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.442317:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.442330:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.442342:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.442351:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.442353:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.442355:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.442439:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.442444:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbc9935f/0x13cfa3d77faa60da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.443002:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.443008:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443017:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.443021:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.443025:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443035:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443043:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443050:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443088:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.443093:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443110:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.443114:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443122:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443133:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443159:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.443161:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.443163:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.443259:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.443264:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fd6923/0x13cfa3d77faa60e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.443679:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.443685:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443693:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.443696:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.443701:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443710:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443718:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.443725:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443751:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.443756:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443827:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.443831:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443840:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443852:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.443866:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.443868:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.443870:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.443931:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.443937:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ffd2827/0x13cfa3d77faa60e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.444382:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.444388:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.444396:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.444400:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.444404:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.444414:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.444422:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.444430:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.444483:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.444488:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.444495:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.444499:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.444508:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.444517:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.444525:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.444527:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.444528:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.444588:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.444593:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008f2de79/0x13cfa3d77faa60ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.444990:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.444996:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445014:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.445017:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.445021:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445030:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445037:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445043:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445129:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.445134:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445140:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5400 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.445161:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445174:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445185:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445193:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.445195:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.445196:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.445246:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.445251:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051fe9a7d/0x13cfa3d77faa60f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.445655:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.445661:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445669:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.445672:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.445676:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445696:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445704:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445711:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445728:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120945.445737:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120945.445741:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445748:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120945.445751:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.445835:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.445861:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445875:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445883:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab666187/0x13cfa3d77faa60fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.445903:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.445905:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.445906:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789120945.446382:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.446389:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446397:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.446400:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.446404:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446414:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446423:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446431:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446487:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789120945.446956:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.446962:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446981:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.446986:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.446990:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.446999:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447006:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447013:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447057:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120945.447064:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447073:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.447077:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447086:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447100:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447108:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f95358/0x13cfa3d77faa6104 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447136:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.447140:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447179:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5c00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.447182:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447191:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447202:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447220:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.447222:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.447224:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.447308:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.447313:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8cd698/0x13cfa3d77faa610b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.447698:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.447703:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447712:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.447716:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.447721:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447741:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447750:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.447757:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447847:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.447852:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447858:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa5200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.447861:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447879:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447890:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.447898:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.447899:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.447901:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.447959:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.447964:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeda7a1a/0x13cfa3d77faa6112 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.448382:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.448388:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.448397:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.448399:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.448404:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.448413:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.448431:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.448439:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.448719:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.448726:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.448734:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.448738:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.448746:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.448757:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.448841:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.448843:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.448844:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.448910:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.448916:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffac1f00/0x13cfa3d77faa6119 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.449362:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.449367:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.449377:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.449380:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.449385:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.449395:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.449403:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.449420:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.449463:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.449468:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.449474:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb5fa4000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.449477:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.449486:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.449496:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.449504:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.449506:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.449507:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.449565:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.449570:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d73b337/0x13cfa3d77faa6120 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120945.450038:0:15517:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789120945.450044:0:15517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.450054:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789120945.450057:0:15517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120945.450061:0:15517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.450069:0:15517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.450076:0:15517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120945.450083:0:15517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.450125:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120945.450130:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.450136:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57e00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:3.0:1789120945.450139:0:14823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.450167:0:14823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.450191:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120945.450200:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.450202:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120945.450204:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.450282:0:15517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789120945.450287:0:15517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e6569c/0x13cfa3d77faa6127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789120945.450481:0:15517:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789120945.450577:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14860:x1876028922369024:12345-0@lo:5:osp-pre-1-0.0 Request processed in 58536us (58947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120945.450586:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789120945.450639:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120945.450673:0:14860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14860:1876028922369024:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789120945.450689:0:14860:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789120945.450734:0:14860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14860:1876028922369152:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789120945.450839:0:14860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120945.450919:0:14860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda0a2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120945.450950:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369152 00000100:00100000:2.0:1789120945.450955:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369152 00000100:00100000:2.0:1789120945.451020:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120945.451029:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14860:x1876028922369152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789120945.451060:0:15516:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789120945.463630:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14860:x1876028922369152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12593us (12782us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789120945.463654:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120945.470076:0:14860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14860:1876028922369152:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789120945.470099:0:14860:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1789120945.995318:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789120945.995335:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1789120946.412917:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120946.735978:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789120947.173561:0:16594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg609-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789120947.439457:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120948.459022:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120948.970401:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120948.970424:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922369280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120948.970500:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120948.970618:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369280 00000100:00100000:3.0:1789120948.970625:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369280 00000100:00100000:3.0:1789120948.970685:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120948.970695:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922369280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120948.970726:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120948.970771:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922369280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120948.970792:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120948.970833:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd906403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922369280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789120948.970918:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120949.039244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.039405:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401728 00000100:00100000:0.0:1789120949.039414:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401728 00000100:00100000:0.0:1789120949.039459:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:0.0:1789120949.039467:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1876028901401728:12345-192.168.206.9@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789120949.039493:0:14830:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from fe626eda-eaae-41e0-a095-c0f5c3ffcaa9@192.168.206.9@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1789120949.040656:0:14830:0:(genops.c:1385:class_connect()) connect: client fe626eda-eaae-41e0-a095-c0f5c3ffcaa9, cookie 0x13cfa3d77faa612e 00000100:00080000:0.0:1789120949.040790:0:14830:0:(import.c:65:import_set_state_nolock()) ffff9ffc83b89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120949.040848:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+5:2348:x1876028901401728:12345-192.168.206.9@tcp:250:mount.lustre.0 Request processed in 1380us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.040858:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 75 00000100:00100000:3.0:1789120949.055850:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.055993:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401856 00000100:00100000:0.0:1789120949.056003:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401856 00000100:00100000:0.0:1789120949.056068:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:0.0:1789120949.056080:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+5:13961:x1876028901401856:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789120949.056096:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120949.056113:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa6135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b133 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.056140:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa6135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b133 expref: 6 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.056200:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ba00/0x13cfa3d77faa6135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b133 expref: 6 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.056210:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ba00, rc 0) 00000100:00100000:0.0:1789120949.056263:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+6:13961:x1876028901401856:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 186us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.056271:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 76 00000100:00100000:1.0:1789120949.064182:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.064299:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901401984 00000100:00100000:0.0:1789120949.064309:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901401984 00000100:00100000:0.0:1789120949.064354:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:0.0:1789120949.064362:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+6:13961:x1876028901401984:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120949.064706:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+6:13961:x1876028901401984:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 343us (570us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120949.064715:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 77 00000100:00100000:3.0:1789120949.072358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.072523:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402112 00000100:00100000:1.0:1789120949.072533:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402112 00000100:00100000:1.0:1789120949.072589:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:1.0:1789120949.072599:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+6:13961:x1876028901402112:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120949.072615:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120949.072633:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa613c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b13a expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.072663:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa613c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b13a expref: 7 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.072674:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99ba000/0x13cfa3d77faa613c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b13a expref: 7 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.072683:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99ba000, rc 0) 00000100:00100000:1.0:1789120949.072764:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+7:13961:x1876028901402112:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 166us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.072785:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 78 00000100:00100000:2.0:1789120949.074484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.074570:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402240 00000100:00100000:1.0:1789120949.074577:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402240 00000100:00100000:1.0:1789120949.074622:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:1.0:1789120949.074631:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+7:13961:x1876028901402240:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789120949.074912:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13961:x1876028901402240:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 281us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.074920:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 79 00000100:00100000:2.0:1789120949.077771:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.077857:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402368 00000100:00100000:0.0:1789120949.077865:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402368 00000100:00100000:0.0:1789120949.077919:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:0.0:1789120949.077946:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13961:x1876028901402368:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789120949.079984:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13961:x1876028901402368:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 2033us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.079996:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 80 00000100:00100000:3.0:1789120949.087981:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.088411:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402496 00000100:00100000:0.0:1789120949.088420:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402496 00000100:00100000:0.0:1789120949.088476:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:0.0:1789120949.088487:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13980:x1876028901402496:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120949.089095:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13980:x1876028901402496:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 606us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.089105:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 81 00000100:00100000:2.0:1789120949.106990:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.108497:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402624 00000100:00100000:0.0:1789120949.108509:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402624 00000100:00100000:0.0:1789120949.108680:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:0.0:1789120949.108690:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13980:x1876028901402624:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120949.108965:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13980:x1876028901402624:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 276us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.108973:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 82 00000100:00100000:2.0:1789120949.112601:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.112760:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402752 00000100:00100000:0.0:1789120949.112769:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402752 00000100:00100000:0.0:1789120949.112834:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:0.0:1789120949.112845:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+8:13961:x1876028901402752:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789120949.112861:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120949.112878:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa6143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b164 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.112923:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa6143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b164 expref: 9 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.112934:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4ac00/0x13cfa3d77faa6143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b164 expref: 9 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120949.112943:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ac00, rc 0) 00000100:00100000:0.0:1789120949.113006:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+9:13961:x1876028901402752:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.113013:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 83 00000100:00100000:3.0:1789120949.116782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.116976:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901402880 00000100:00100000:0.0:1789120949.116985:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901402880 00000100:00100000:0.0:1789120949.117043:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:0.0:1789120949.117052:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+9:13961:x1876028901402880:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789120949.117078:0:14830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789120949.117100:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789120949.117104:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789120949.117107:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789120949.117109:0:14830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789120949.124263:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+9:13961:x1876028901402880:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 7203us (7480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.124280:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 84 00000100:00100000:2.0:1789120949.132729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.132806:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403008 00000100:00100000:1.0:1789120949.132825:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403008 00000100:00100000:1.0:1789120949.132936:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:1.0:1789120949.132947:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc81187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+9:13961:x1876028901403008:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120949.132964:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120949.132982:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b16b expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.133011:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 10 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.133021:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 10 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.133030:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb200, rc 0) 00000100:00100000:1.0:1789120949.133088:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc81187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13961:x1876028901403008:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.133096:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 85 00000100:00100000:3.0:1789120949.136448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.137023:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403136 00000100:00100000:0.0:1789120949.137033:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403136 00000100:00100000:0.0:1789120949.137095:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:0.0:1789120949.137105:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13961:x1876028901403136:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120949.137455:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13961:x1876028901403136:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 350us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.137463:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 86 00000100:00100000:2.0:1789120949.148892:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.148992:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403264 00000100:00100000:1.0:1789120949.149003:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403264 00000100:00100000:1.0:1789120949.149059:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:1.0:1789120949.149068:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13961:x1876028901403264:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789120949.149515:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13961:x1876028901403264:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 447us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.149523:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 87 00000100:00100000:2.0:1789120949.153906:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.154895:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403392 00000100:00100000:1.0:1789120949.154905:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403392 00000100:00100000:1.0:1789120949.155014:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:1.0:1789120949.155026:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13985:x1876028901403392:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120949.155359:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13985:x1876028901403392:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 334us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.155367:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 88 00000100:00100000:3.0:1789120949.158521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120949.158655:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403520 00000100:00100000:0.0:1789120949.158664:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403520 00000100:00100000:0.0:1789120949.158715:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:0.0:1789120949.158724:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13985:x1876028901403520:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120949.158946:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:13985:x1876028901403520:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 222us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.158954:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 89 00000100:00100000:2.0:1789120949.166282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120949.166363:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403648 00000100:00100000:3.0:1789120949.166373:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403648 00000100:00100000:3.0:1789120949.166414:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789120949.166422:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1876028901403648:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789120949.166450:0:14836:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 8188027b-f5f1-41c7-85a7-84ef28178cbf@192.168.206.9@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:3.0:1789120949.166494:0:14836:0:(genops.c:1385:class_connect()) connect: client 8188027b-f5f1-41c7-85a7-84ef28178cbf, cookie 0x13cfa3d77faa6151 00000004:00100000:3.0:1789120949.166522:0:14836:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789120949.166528:0:14836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789120949.202400:0:14836:0:(import.c:65:import_set_state_nolock()) ffff9ffc83335000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120949.202514:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2348:x1876028901403648:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 36090us (36238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120949.202524:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789120949.210606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120949.210675:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403904 00000100:00100000:3.0:1789120949.210684:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403904 00000100:00100000:3.0:1789120949.210768:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:3.0:1789120949.210782:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901403904:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789120949.210836:0:14835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789120949.210940:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901403904:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120949.210948:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00080000:1.0:1789120949.211394:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120949.213257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.213394:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901403776 00000100:00100000:1.0:1789120949.213402:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901403776 00000100:00100000:1.0:1789120949.213663:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120949.213673:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:0:x1876028901403776:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789120949.213700:0:14837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789120949.213761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.213780:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:0:x1876028901403776:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 109us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.213788:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120949.213875:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404032 00000100:00100000:1.0:1789120949.213881:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404032 00000100:00100000:1.0:1789120949.213912:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:1.0:1789120949.213932:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901404032:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789120949.213965:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901404032:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 35us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.213972:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789120949.218383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120949.218429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120949.218464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120949.218812:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404416 00000100:00100000:3.0:1789120949.218821:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404416 00000100:00100000:3.0:1789120949.218875:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:3.0:1789120949.218884:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901404416:12345-192.168.206.9@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789120949.219450:0:14838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 508us 00000100:00100000:0.0:1789120949.219698:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404160 00000100:00100000:0.0:1789120949.219704:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404160 00000100:00100000:0.0:1789120949.219731:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404288 00000100:00100000:0.0:1789120949.219734:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404288 00000100:00100000:0.0:1789120949.219749:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789120949.219756:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901404160:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789120949.219787:0:15518:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 8188027b-f5f1-41c7-85a7-84ef28178cbf@192.168.206.9@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1789120949.219826:0:15518:0:(genops.c:1385:class_connect()) connect: client 8188027b-f5f1-41c7-85a7-84ef28178cbf, cookie 0x13cfa3d77faa6158 00002000:00100000:0.0:1789120949.220031:0:15518:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8188027b-f5f1-41c7-85a7-84ef28178cbf/ffff9ffc83b8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789120949.220043:0:15518:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789120949.220751:0:15518:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789120949.220782:0:15518:0:(import.c:65:import_set_state_nolock()) ffff9ffc83b8f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120949.221013:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2348:x1876028901404160:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 1254us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.221030:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789120949.221182:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789120949.221199:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1876028901404288:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789120949.221221:0:15518:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 8188027b-f5f1-41c7-85a7-84ef28178cbf@192.168.206.9@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:0.0:1789120949.221247:0:15518:0:(genops.c:1385:class_connect()) connect: client 8188027b-f5f1-41c7-85a7-84ef28178cbf, cookie 0x13cfa3d77faa615f 00002000:00100000:0.0:1789120949.221256:0:15518:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8188027b-f5f1-41c7-85a7-84ef28178cbf/ffff9ffc83b89000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789120949.221274:0:15518:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789120949.221650:0:15518:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789120949.221676:0:15518:0:(import.c:65:import_set_state_nolock()) ffff9ffc83b8b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120949.221719:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2348:x1876028901404288:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 528us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.221729:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000004:00200000:1.0:1789120949.241710:0:14838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1789120949.241867:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:13961:x1876028901404416:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 22979us (23433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.241882:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789120949.417492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120949.418014:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404544 00000100:00100000:1.0:1789120949.418024:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404544 00000100:00100000:1.0:1789120949.418085:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:1.0:1789120949.418095:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:14007:x1876028901404544:12345-192.168.206.9@tcp:101:mkdir.0 00010000:00010000:1.0:1789120949.418115:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120949.418139:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa6166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b195 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418243:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418256:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418270:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120949.418454:0:14837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789120949.418459:0:14837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789120949.418550:0:14837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418582:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb600/0x13cfa3d77faa6166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b195 expref: 8 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418599:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b195 expref: 7 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120949.418608:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:1.0:1789120949.418611:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120949.418615:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bae00, rc 0) 00000100:00100000:1.0:1789120949.418679:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14007:x1876028901404544:12345-192.168.206.9@tcp:101:mkdir.0 Request processed in 585us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.418686:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:3.0:1789120949.483994:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120950.506426:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120950.506596:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922369408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120950.506650:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922369664:0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.506668:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120950.506696:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120950.506741:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120950.506748:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922369536:0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.506784:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120950.506794:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922369792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.506817:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922369920:0@lo:400:kworker.0 00000100:00100000:1.0:1789120950.506834:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120950.506858:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369408 00000100:00100000:3.0:1789120950.506865:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369408 00000100:00100000:1.0:1789120950.506884:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120950.506909:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120950.506916:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922370048:0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.506922:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120950.506933:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922369408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120950.506947:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789120950.506955:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789120950.506973:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120950.506987:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369536 00000100:00100000:1.0:1789120950.506991:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369536 00000100:00100000:3.0:1789120950.507004:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922369408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120950.507012:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120950.507020:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789120950.507028:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3319:x1876028922369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.507054:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369792 00000100:00100000:3.0:1789120950.507059:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369792 00000100:00100000:1.0:1789120950.507064:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3319:x1876028922369536:12345-0@lo:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120950.507072:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789120950.507089:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369920 00000100:00100000:3.0:1789120950.507093:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369920 00000100:00080000:1.0:1789120950.507112:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120950.507118:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370048 00000100:00100000:3.0:1789120950.507122:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370048 00000100:00100000:1.0:1789120950.507138:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3319:1876028922369536:0@lo:400:kworker.0 00000100:00100000:1.0:1789120950.507176:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789120950.507189:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120950.507199:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922369792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120950.507210:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83461a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922369408:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789120950.507232:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120950.507244:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922369792:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120950.507252:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789120950.507255:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922369792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.507270:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789120950.507279:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922369920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120950.507284:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789120950.507305:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922370048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120950.507312:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876028922369920:12345-0@lo:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120950.507318:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789120950.507469:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922369664 00000100:00100000:0.0:1789120950.507473:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922369664 00000100:00100000:0.0:1789120950.507515:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120950.507523:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120950.507556:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876028922369664:12345-0@lo:400:kworker.0 Request processed in 34us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120950.507562:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120950.507604:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876028922369920:0@lo:400:kworker.0 00000100:00100000:1.0:1789120950.507894:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922370048:12345-0@lo:400:kworker.0 Request processed in 601us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120950.507902:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789120950.509978:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120950.511384:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876028922369664:0@lo:400:kworker.0 00000100:00100000:0.0:1789120950.512037:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922370048:0@lo:400:kworker.0 00000001:00100000:0.0:1789120951.070094:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8188027b-f5f1-41c7-85a7-84ef28178cbf 00000100:00100000:0.0:1789120951.395299:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.395493:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404672 00000100:00100000:3.0:1789120951.395505:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404672 00000100:00100000:3.0:1789120951.395590:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:3.0:1789120951.395603:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14059:x1876028901404672:12345-192.168.206.9@tcp:41:lfs.0 00000004:00000024:3.0:1789120951.395672:0:14836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789120951.396051:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14059:x1876028901404672:12345-192.168.206.9@tcp:41:lfs.0 Request processed in 419us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.396061:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00080000:1.0:1789120951.396233:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120951.401397:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.401716:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404800 00000100:00100000:3.0:1789120951.401729:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404800 00000100:00100000:3.0:1789120951.401926:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:3.0:1789120951.401958:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:14059:x1876028901404800:12345-192.168.206.9@tcp:13:lfs.0 00002000:00000024:3.0:1789120951.402018:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120951.402693:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:14059:x1876028901404800:12345-192.168.206.9@tcp:13:lfs.0 Request processed in 735us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.402704:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789120951.407979:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.408120:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901404928 00000100:00100000:3.0:1789120951.408132:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901404928 00000100:00080000:1.0:1789120951.408286:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120951.408292:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120951.408934:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:3.0:1789120951.408950:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:14059:x1876028901404928:12345-192.168.206.9@tcp:13:lfs.0 00002000:00000024:3.0:1789120951.409004:0:15521:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789120951.409119:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:14059:x1876028901404928:12345-192.168.206.9@tcp:13:lfs.0 Request processed in 174us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.409128:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00010000:00010000:3.0:1789120951.532006:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789120951.603520:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8188027b-f5f1-41c7-85a7-84ef28178cbf 00000100:00100000:0.0:1789120951.636057:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120951.636199:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405056 00000100:00100000:1.0:1789120951.636211:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405056 00000100:00100000:1.0:1789120951.636286:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:1.0:1789120951.636297:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+10:14090:x1876028901405056:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120951.636318:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120951.636581:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa6174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b19c expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.636617:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa6174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b19c expref: 11 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.636629:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bb600/0x13cfa3d77faa6174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b19c expref: 11 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.636659:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bb600, rc 0) 00000100:00100000:1.0:1789120951.636958:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405056:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 661us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.636967:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 91 00000100:00100000:2.0:1789120951.650289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.650421:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405184 00000100:00100000:0.0:1789120951.650438:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405184 00000100:00100000:0.0:1789120951.650521:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:0.0:1789120951.650533:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405184:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120951.651097:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405184:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 564us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.651108:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 92 00000100:00100000:3.0:1789120951.658657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120951.658850:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405312 00000100:00100000:1.0:1789120951.658862:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405312 00000100:00100000:1.0:1789120951.658932:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:1.0:1789120951.658943:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405312:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789120951.659410:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405312:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 466us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.659420:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 93 00000100:00100000:1.0:1789120951.667235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.674856:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405440 00000100:00100000:2.0:1789120951.674876:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405440 00000100:00100000:3.0:1789120951.682891:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:3.0:1789120951.684270:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14098:x1876028901405440:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120951.685127:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14098:x1876028901405440:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 2212us (17899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.685169:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 94 00000100:00100000:2.0:1789120951.718981:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.719441:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405568 00000100:00100000:0.0:1789120951.719456:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405568 00000100:00100000:0.0:1789120951.719582:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:0.0:1789120951.719594:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14098:x1876028901405568:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120951.720080:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14098:x1876028901405568:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 485us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.720089:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 95 00000100:00100000:0.0:1789120951.730590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.731956:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405696 00000100:00100000:3.0:1789120951.731975:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405696 00000100:00100000:3.0:1789120951.732240:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:3.0:1789120951.732255:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:14090:x1876028901405696:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789120951.732297:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120951.732320:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa617b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b1c6 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120951.732358:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa617b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1c6 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120951.732370:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b600/0x13cfa3d77faa617b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1c6 expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120951.732381:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b600, rc 0) 00000100:00100000:3.0:1789120951.732471:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:14090:x1876028901405696:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 219us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.732481:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 96 00000100:00100000:2.0:1789120951.736456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.736598:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405824 00000100:00100000:0.0:1789120951.736611:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405824 00000100:00100000:0.0:1789120951.736686:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:0.0:1789120951.736698:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:14090:x1876028901405824:12345-192.168.206.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789120951.736730:0:14830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789120951.736760:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789120951.736765:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789120951.736768:0:14830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789120951.736771:0:14830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789120951.747607:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:14090:x1876028901405824:12345-192.168.206.9@tcp:256:mount.lustre.0 Request processed in 10893us (11214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.747640:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 97 00000100:00100000:3.0:1789120951.757297:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120951.757544:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901405952 00000100:00100000:1.0:1789120951.757558:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901405952 00000100:00100000:1.0:1789120951.757628:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:1.0:1789120951.757641:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:14090:x1876028901405952:12345-192.168.206.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789120951.757662:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120951.757685:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b1cd expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.757736:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.757751:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120951.757982:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bbe00, rc 0) 00000100:00100000:1.0:1789120951.758067:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14090:x1876028901405952:12345-192.168.206.9@tcp:101:mount.lustre.0 Request processed in 428us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.758075:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 98 00000100:00100000:2.0:1789120951.763489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.763657:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406080 00000100:00100000:0.0:1789120951.763671:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406080 00000100:00100000:0.0:1789120951.763738:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:0.0:1789120951.763750:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14090:x1876028901406080:12345-192.168.206.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120951.764196:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14090:x1876028901406080:12345-192.168.206.9@tcp:501:mount.lustre.0 Request processed in 395us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.764207:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 99 00000100:00100000:2.0:1789120951.773336:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.773486:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406208 00000100:00100000:0.0:1789120951.773498:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406208 00000100:00100000:0.0:1789120951.773563:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:0.0:1789120951.773573:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb55ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14090:x1876028901406208:12345-192.168.206.9@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789120951.773928:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb55ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14090:x1876028901406208:12345-192.168.206.9@tcp:503:mount.lustre.0 Request processed in 354us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.773937:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 100 00000100:00100000:3.0:1789120951.782750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120951.783015:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406336 00000100:00100000:1.0:1789120951.783029:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406336 00000100:00100000:1.0:1789120951.783108:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:1.0:1789120951.783120:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14103:x1876028901406336:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120951.783563:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14103:x1876028901406336:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 442us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.783572:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 101 00000100:00100000:2.0:1789120951.798419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.798546:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406464 00000100:00100000:3.0:1789120951.798558:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406464 00000100:00100000:3.0:1789120951.798634:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:3.0:1789120951.798646:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14103:x1876028901406464:12345-192.168.206.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120951.799047:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:14103:x1876028901406464:12345-192.168.206.9@tcp:502:llog_process_th.0 Request processed in 402us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.799057:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 102 00000100:00100000:2.0:1789120951.822804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.822850:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.822886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.823053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.823121:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406592 00000100:00100000:3.0:1789120951.823132:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406592 00000100:00100000:3.0:1789120951.823220:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406976 00000100:00100000:3.0:1789120951.823223:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406976 00000100:00100000:3.0:1789120951.823288:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120951.823298:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2351:x1876028901406976:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120951.823398:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2351:x1876028901406976:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 101us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.823406:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120951.823427:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:3.0:1789120951.823433:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1876028901406592:12345-192.168.206.9@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789120951.823461:0:16250:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4f36552f-038e-4e0c-927f-25dfe7787a8b@192.168.206.9@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:3.0:1789120951.823506:0:16250:0:(genops.c:1385:class_connect()) connect: client 4f36552f-038e-4e0c-927f-25dfe7787a8b, cookie 0x13cfa3d77faa6189 00000004:00100000:3.0:1789120951.823543:0:16250:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789120951.823693:0:16250:0:(import.c:65:import_set_state_nolock()) ffff9ffdb7f6e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120951.823726:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2348:x1876028901406592:12345-192.168.206.9@tcp:38:mount.lustre.0 Request processed in 293us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.823734:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:2.0:1789120951.831315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.831365:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.831404:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406720 00000100:00100000:2.0:1789120951.831415:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406720 00000100:00100000:2.0:1789120951.831486:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901406848 00000100:00100000:2.0:1789120951.831490:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901406848 00000100:00100000:2.0:1789120951.831516:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789120951.831528:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+7:0:x1876028901406720:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789120951.831610:0:14836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789120951.831703:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+7:0:x1876028901406720:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.831711:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789120951.831735:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120951.831741:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901406848:12345-192.168.206.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789120951.831753:0:14836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789120951.831776:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901406848:12345-192.168.206.9@tcp:41:mount.lustre.0 Request processed in 35us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.831782:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00080000:2.0:1789120951.831803:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120951.835273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120951.835636:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407360 00000100:00100000:2.0:1789120951.835649:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407360 00000100:00100000:2.0:1789120951.837269:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120951.838133:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901407360:12345-192.168.206.9@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789120951.838874:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901407360:12345-192.168.206.9@tcp:40:mount.lustre.0 Request processed in 1062us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.838887:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120951.841978:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120951.842013:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120951.842083:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407232 00000100:00100000:0.0:1789120951.842097:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407232 00000100:00100000:0.0:1789120951.842245:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407104 00000100:00100000:0.0:1789120951.842249:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407104 00000100:00100000:0.0:1789120951.842274:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789120951.842285:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83461e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901407232:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120951.842384:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83461e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901407232:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 100us (19496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.842393:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789120951.842414:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:0.0:1789120951.842440:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901407104:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120951.842470:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901407104:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 31us (19417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.842476:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789120951.842821:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407744 00000100:00100000:2.0:1789120951.842828:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407744 00000100:00100000:2.0:1789120951.842866:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:2.0:1789120951.842875:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901407744:12345-192.168.206.9@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789120951.843228:0:14839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789120951.843387:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14090:x1876028901407744:12345-192.168.206.9@tcp:33:mount.lustre.0 Request processed in 512us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.843406:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789120951.844773:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407488 00000100:00100000:1.0:1789120951.844792:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407488 00000100:00100000:1.0:1789120951.844852:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120951.844861:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1876028901407488:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789120951.844917:0:15516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4f36552f-038e-4e0c-927f-25dfe7787a8b@192.168.206.9@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1789120951.844959:0:15516:0:(genops.c:1385:class_connect()) connect: client 4f36552f-038e-4e0c-927f-25dfe7787a8b, cookie 0x13cfa3d77faa6190 00002000:00100000:1.0:1789120951.844975:0:15516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4f36552f-038e-4e0c-927f-25dfe7787a8b/ffff9ffd9d194800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120951.844989:0:15516:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789120951.844999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00002000:00080000:1.0:1789120951.845308:0:15516:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120951.845347:0:15516:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d197000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120951.845427:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2348:x1876028901407488:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 564us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.845450:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120951.845472:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407616 00000100:00100000:1.0:1789120951.845476:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407616 00000100:00100000:1.0:1789120951.845490:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789120951.845495:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1876028901407616:12345-192.168.206.9@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789120951.845515:0:15516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4f36552f-038e-4e0c-927f-25dfe7787a8b@192.168.206.9@tcp t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1789120951.845536:0:15516:0:(genops.c:1385:class_connect()) connect: client 4f36552f-038e-4e0c-927f-25dfe7787a8b, cookie 0x13cfa3d77faa6197 00002000:00100000:1.0:1789120951.845542:0:15516:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4f36552f-038e-4e0c-927f-25dfe7787a8b/ffff9ffd9d194000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120951.845549:0:15516:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789120951.845707:0:15516:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789120951.845730:0:15516:0:(import.c:65:import_set_state_nolock()) ffff9ffd9d195800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120951.845759:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2348:x1876028901407616:12345-192.168.206.9@tcp:8:mount.lustre.0 Request processed in 263us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.845766:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:3.0:1789120952.011900:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120952.012135:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901407872 00000100:00100000:2.0:1789120952.012191:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901407872 00000100:00100000:2.0:1789120952.012267:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789120952.012279:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14125:x1876028901407872:12345-192.168.206.9@tcp:101:mkdir.0 00010000:00010000:2.0:1789120952.012305:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120952.012335:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa619e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b1f7 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012417:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012509:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012527:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120952.012798:0:14837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789120952.012803:0:14837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120952.012888:0:14837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012920:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa619e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 8 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012940:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 7 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120952.012962:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:2.0:1789120952.012965:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120952.012970:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57200, rc 0) 00000100:00100000:2.0:1789120952.013049:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+7:14125:x1876028901407872:12345-192.168.206.9@tcp:101:mkdir.0 Request processed in 772us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120952.013057:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00010000:00010000:3.0:1789120952.555365:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120953.582555:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120954.091627:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120954.091672:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922370176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120954.091767:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120954.092029:0:15521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370176 00000100:00100000:2.0:1789120954.092040:0:15521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370176 00000100:00100000:2.0:1789120954.092120:0:15521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789120954.092132:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120954.092134:0:15521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922370176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120954.092222:0:15521:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120954.093015:0:15521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922370176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 883us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.093026:0:15521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120954.101253:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922370176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789120954.609995:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789120954.656424:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4f36552f-038e-4e0c-927f-25dfe7787a8b 00000001:00100000:2.0:1789120954.656442:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8188027b-f5f1-41c7-85a7-84ef28178cbf 00000001:02000400:3.0:1789120954.962408:0:16798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789120955.626400:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922370304:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.626496:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120955.626867:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922370816:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.626903:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120955.626936:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120955.626942:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922370688:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.626968:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120955.627015:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922370432:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.627044:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120955.627062:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922370944:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.627099:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120955.627118:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120955.627124:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922370560:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.627190:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120955.627838:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370816 00000100:00100000:2.0:1789120955.627848:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370816 00000100:00100000:2.0:1789120955.627914:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370688 00000100:00100000:2.0:1789120955.627918:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370688 00000100:00100000:2.0:1789120955.627936:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370944 00000100:00100000:2.0:1789120955.627939:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370944 00000100:00100000:2.0:1789120955.627960:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120955.627971:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922370816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.628045:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922370816:12345-0@lo:400:kworker.0 Request processed in 76us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120955.628064:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120955.628083:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120955.628090:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922370688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.628124:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876028922370688:12345-0@lo:400:kworker.0 Request processed in 34us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120955.628130:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120955.628171:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789120955.628179:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922370944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.628207:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922370944:12345-0@lo:400:kworker.0 Request processed in 30us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120955.628794:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370304 00000100:00100000:1.0:1789120955.628800:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370304 00000100:00100000:1.0:1789120955.628841:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120955.628847:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922370304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.628890:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922370304:12345-0@lo:400:kworker.0 Request processed in 44us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120955.628897:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120955.628940:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370432 00000100:00100000:1.0:1789120955.628944:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370432 00000100:00100000:1.0:1789120955.628969:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922370560 00000100:00100000:1.0:1789120955.628972:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922370560 00000100:00100000:1.0:1789120955.628993:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120955.629000:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922370432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.629034:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922370432:12345-0@lo:400:kworker.0 Request processed in 34us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120955.629040:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120955.629053:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120955.629059:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922370560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.629087:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922370560:12345-0@lo:400:kworker.0 Request processed in 28us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120955.629093:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120955.629122:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5ddb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922371072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120955.629197:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120955.630331:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789120955.630454:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120955.630460:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120955.630476:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120955.631409:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922370560:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.631426:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371072 00000100:00100000:1.0:1789120955.631435:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371072 00000100:00100000:2.0:1789120955.631436:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922370432:0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.631455:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922370944:0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.631503:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876028922370688:0@lo:400:kworker.0 00000100:00100000:1.0:1789120955.631504:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789120955.631514:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922371072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120955.631562:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120955.631644:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922371072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120955.631652:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789120955.631950:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5ddb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922371072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120955.632020:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922370304:0@lo:400:kworker.0 00000100:00100000:2.0:1789120955.632065:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922370816:0@lo:400:kworker.0 00000001:00100000:0.0:1789120956.214529:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4f36552f-038e-4e0c-927f-25dfe7787a8b 00010000:00010000:3.0:1789120956.650435:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789120956.738801:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4f36552f-038e-4e0c-927f-25dfe7787a8b 00000100:00100000:3.0:1789120956.858841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120956.858895:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120956.858961:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408000 00000100:00100000:1.0:1789120956.858973:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408000 00000100:00100000:1.0:1789120956.859032:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:1.0:1789120956.859043:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2352:x1876028901408000:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120956.859130:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2352:x1876028901408000:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.859139:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 104 00000100:00100000:1.0:1789120956.859781:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408128 00000100:00100000:1.0:1789120956.859788:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408128 00000100:00100000:1.0:1789120956.859844:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:1.0:1789120956.859853:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2352:x1876028901408128:12345-192.168.206.9@tcp:400:kworker.0 00000100:00080000:2.0:1789120956.859877:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120956.859897:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2352:x1876028901408128:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 45us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.859904:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:0.0:1789120956.866225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120956.866406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120956.866450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120956.866483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120956.866525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120956.866564:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408384 00000100:00100000:0.0:1789120956.866577:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408384 00000100:00100000:0.0:1789120956.866643:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408640 00000100:00100000:0.0:1789120956.866735:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408640 00000100:00100000:0.0:1789120956.866760:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408256 00000100:00100000:0.0:1789120956.866763:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408256 00000100:00100000:0.0:1789120956.866783:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408768 00000100:00100000:0.0:1789120956.866786:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408768 00000100:00100000:2.0:1789120956.866792:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789120956.866808:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901408384:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120956.866843:0:15516:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120956.866852:0:15516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789120956.866869:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789120956.866882:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789120956.866892:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901408640:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120956.866913:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901408384:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 108us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120956.866923:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:0.0:1789120956.866932:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901408640:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 41us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120956.866943:0:15518:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789120956.866950:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:2.0:1789120956.866957:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789120956.866966:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901408256:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120956.866968:0:15517:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789120956.866980:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789120956.866990:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901408768:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120956.866999:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901408256:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 33us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120956.867006:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789120956.867026:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901408768:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 37us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.867034:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789120956.867062:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408512 00000100:00100000:0.0:1789120956.867065:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408512 00000100:00100000:0.0:1789120956.867293:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:0.0:1789120956.867302:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2351:x1876028901408512:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:0.0:1789120956.867361:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2351:x1876028901408512:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 60us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.867368:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00080000:1.0:1789120956.867953:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120956.867962:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120956.867965:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789120956.971309:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789120957.674232:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120958.048777:0:16950:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd51ea6970 20000000:00000080:3.0:1789120958.048904:0:16950:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ffc8342c400 uarg=0000000000000000 20000000:01000000:3.0:1789120958.048936:0:16950:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120958.048941:0:16950:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120958.048946:0:16950:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789120958.051314:0:16951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789120958.051477:0:16950:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789120958.063417:0:16950:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789120958.064609:0:16950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064629:0:16950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064637:0:16950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 18 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064644:0:16950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064653:0:16950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064660:0:16950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064667:0:16950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064717:0:16950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064731:0:16950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 12 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.064763:0:16950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371200:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120958.064877:0:16950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 12 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064886:0:16950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 12 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.064895:0:16950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371328:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120958.064924:0:16950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.064932:0:16950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.064940:0:16950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371456:0@lo:104: 00000100:00100000:1.0:1789120958.064975:0:16950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120958.065018:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371456 00000100:00100000:3.0:1789120958.065026:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371456 00000100:00100000:3.0:1789120958.065077:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120958.065097:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:16950:x1876028922371456:12345-0@lo:104: 00010000:00010000:3.0:1789120958.065262:0:14819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.065380:0:16950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 18 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.065388:0:16950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 18 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.065397:0:16950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371584:0@lo:104: 00000100:00100000:1.0:1789120958.065421:0:16950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120958.065504:0:16950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.065513:0:16950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.065517:0:14819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120958.065528:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:16950:x1876028922371456:12345-0@lo:104: Request processed in 441us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120958.065536:0:16950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371712:0@lo:104: 00000100:00100000:3.0:1789120958.065541:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120958.065563:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371584 00000100:00100000:3.0:1789120958.065567:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371584 00000100:00100000:1.0:1789120958.065572:0:16950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120958.073547:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120958.073560:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.073571:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149b800 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:3.0:1789120958.073576:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.073587:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120958.073594:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120958.073615:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120958.073675:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.073681:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120958.073704:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.073711:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa601d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa6024 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120958.073725:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120958.073727:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120958.073729:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120958.073840:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922371840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120958.073900:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120958.074026:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371840 00000100:00100000:2.0:1789120958.074034:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371840 00010000:00010000:2.0:1789120958.074063:0:14822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 19 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120958.074093:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120958.074102:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3317:x1876028922371840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120958.074114:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120958.074120:0:14822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 19 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120958.074130:0:14822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 19 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120958.074249:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120958.074364:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3317:x1876028922371840:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120958.074384:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120958.074428:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3317:1876028922371840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120958.074570:0:16950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd89f2d300 going to sleep for 11 seconds 00010000:00010000:1.0:1789120958.074587:0:16950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bba00/0x13cfa3d77faa6024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa601d expref: 18 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.074599:0:16950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371456:0@lo:104: 00000100:00100000:1.0:1789120958.074682:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120958.074748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120958.074767:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901408896 00000100:00100000:1.0:1789120958.074771:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901408896 00010000:00010000:1.0:1789120958.074790:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 13 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.074806:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409024 00000100:00100000:1.0:1789120958.074809:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409024 00010000:00010000:1.0:1789120958.074821:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 14 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.074831:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120958.074836:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+14:2350:x1876028901408896:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120958.074844:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120958.074848:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 14 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.074856:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 14 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.074878:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120958.074910:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+14:2350:x1876028901408896:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120958.074917:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120958.074931:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120958.074938:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2349:x1876028901409024:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120958.074944:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120958.074949:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 13 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.074956:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 13 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.074964:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120958.074979:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2349:x1876028901409024:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 43us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120958.074984:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789120958.075216:0:14818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789120958.075229:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371712 00000100:00100000:0.0:1789120958.075232:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371712 00000100:00100000:0.0:1789120958.075254:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120958.075261:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+4:16950:x1876028922371584:12345-0@lo:104: 00010000:00010000:0.0:1789120958.075272:0:14818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075310:0:14818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120958.075316:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+4:16950:x1876028922371584:12345-0@lo:104: Request processed in 56us (9895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120958.075328:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120958.075341:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120958.075347:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc811e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:16950:x1876028922371712:12345-0@lo:104: 00010000:00010000:0.0:1789120958.075354:0:14818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075388:0:14818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120958.075393:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc811e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+3:16950:x1876028922371712:12345-0@lo:104: Request processed in 46us (9824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120958.075398:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789120958.075432:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120958.075438:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075444:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120958.075448:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075464:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120958.075472:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120958.075477:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789120958.075500:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075507:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120958.075527:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075533:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4aa00/0x13cfa3d77faa5ee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ef0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075544:0:14823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120958.075547:0:14823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075553:0:14823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba400 already unused, calling callback (ffffffffc1ab9c20) 10000000:00010000:0.0:1789120958.075555:0:14823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075562:0:14823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120958.075568:0:14823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120958.075573:0:14823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789120958.075586:0:14823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075591:0:14823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120958.075743:0:14823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075751:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.109@tcp lock: ffff9ffdb99ba400/0x13cfa3d77faa5e9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x13cfa3d77faa5ea3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.075773:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120958.075775:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120958.075777:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120958.075784:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120958.075794:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922372096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120958.075826:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120958.075914:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372096 00000100:00100000:1.0:1789120958.075918:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372096 00000100:00100000:3.0:1789120958.075935:0:14819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:1.0:1789120958.075936:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.075957:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120958.075963:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:3320:x1876028922372096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120958.075972:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120958.075976:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.075991:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 18 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.076002:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120958.076052:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:3320:x1876028922372096:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120958.076059:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789120958.076095:0:16950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bbe00/0x13cfa3d77faa6182 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1cd expref: 12 pid: 14828 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.076106:0:16950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371200:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120958.076117:0:16950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99bb200/0x13cfa3d77faa614a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b16b expref: 11 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.076125:0:16950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371328:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120958.076135:0:16950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371584:0@lo:104: 00010000:00010000:1.0:1789120958.076173:0:16950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffda0d4ae00/0x13cfa3d77faa5ea3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5e9c expref: 17 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120958.076182:0:16950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16950:1876028922371712:0@lo:104: 00010000:00010000:1.0:1789120958.076204:0:16950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120958.076319:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3320:1876028922372096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120958.077854:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120958.078092:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922371968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120958.078174:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120958.078384:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922371968 00000100:00100000:0.0:1789120958.078392:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922371968 00010000:00010000:0.0:1789120958.078426:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 17 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120958.078465:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120958.078474:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:3318:x1876028922371968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120958.078487:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120958.078492:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 17 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078502:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 17 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078519:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffd81690400/0x13cfa3d77faa5ef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x13cfa3d77faa5ee9 expref: 17 pid: 14829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078534:0:14821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078558:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078578:0:14821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078585:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078591:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078598:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078605:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120958.078609:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078617:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078636:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120958.078650:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120958.078695:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:3318:x1876028922371968:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120958.078702:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789120958.078755:0:16950:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.078763:0:16950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120958.078774:0:16950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ffdb99ba800/0x13cfa3d77faa61ac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120958.078904:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922371968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120958.698358:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789120959.211192:0:14833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120959.211199:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd85287800 from 13 10000000:01000000:3.0:1789120959.211203:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120959.211246:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.211258:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.211269:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120959.211293:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.211372:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.211421:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120959.211443:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372224 00000100:00100000:3.0:1789120959.211449:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372224 00000100:00100000:2.0:1789120959.211887:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120959.211923:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120959.211967:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372352 00000100:00100000:2.0:1789120959.211971:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372352 00000100:00100000:2.0:1789120959.212013:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789120959.212022:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922372352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120959.212055:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789120959.212097:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922372352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.212104:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789120959.212122:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120959.212181:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120959.212703:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789120959.212721:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+16:14833:x1876028922372224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120959.212731:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120959.212746:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149ae00/0x13cfa3d77faa61ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa61b3 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.212767:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149ae00/0x13cfa3d77faa61ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa61b3 expref: 17 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.212777:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149ae00/0x13cfa3d77faa61ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa61b3 expref: 17 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.212785:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149ae00, rc 0) 00000100:00100000:3.0:1789120959.212828:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.212834:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789120959.212874:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90643840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120959.212891:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61ba expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.212902:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa61ba expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120959.212970:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.212999:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120959.213016:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8f8e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120959.220914:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372480 00000100:00100000:1.0:1789120959.220928:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372480 00000100:00100000:1.0:1789120959.220999:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789120959.221010:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120959.221359:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (8357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120959.221368:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789120959.224238:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.224315:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.224390:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.224439:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd90c5d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789120959.224558:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372608 00000100:00100000:0.0:1789120959.224565:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372608 00000100:00100000:0.0:1789120959.224610:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789120959.224618:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120959.224820:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120959.224828:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789120959.225050:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789120959.226130:0:16991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789120959.226392:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789120959.226411:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120959.226420:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61ba expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.226432:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffd8149b800/0x13cfa3d77faa61b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61ba expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120959.226441:0:14833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120959.226444:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffdaa06b800 from 13 10000000:01000000:0.0:1789120959.226446:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120959.226479:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.226486:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.226495:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120959.226515:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb98ead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120959.226564:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120959.226619:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120959.226964:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372736 00000100:00100000:3.0:1789120959.226977:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372736 00000100:00100000:3.0:1789120959.227025:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789120959.227035:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+17:14833:x1876028922372736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120959.227047:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120959.227059:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa61c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa61c1 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.227082:0:14830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa61c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa61c1 expref: 18 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.227092:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b200/0x13cfa3d77faa61c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa61c1 expref: 18 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.227100:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b200, rc 0) 00000100:00100000:3.0:1789120959.227173:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922372736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.227180:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789120959.227364:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb98ead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120959.227380:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61c8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.227388:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa61c8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120959.227439:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.227468:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120959.227485:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8f8e50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120959.227499:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372864 00000100:00100000:2.0:1789120959.227502:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372864 00000100:00100000:2.0:1789120959.227528:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789120959.227535:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922372864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.227930:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922372864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.227937:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789120959.228051:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.228083:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.228124:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.228194:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120959.228362:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922372992 00000100:00100000:2.0:1789120959.228367:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922372992 00000100:00100000:2.0:1789120959.228401:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789120959.228409:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922372992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.228612:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922372992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.228626:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789120959.231878:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90641a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922372992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789120959.237787:0:16993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789120959.240899:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789120959.240929:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120959.240939:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61c8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.240952:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0d4be00/0x13cfa3d77faa61c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61c8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120959.240962:0:14833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120959.240965:0:14833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ffd82c7a800 from 13 10000000:01000000:2.0:1789120959.240968:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120959.241002:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.241010:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.241020:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120959.241044:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.241104:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120959.241181:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8f8e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120959.241261:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373120 00000100:00100000:0.0:1789120959.241268:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373120 00000100:00100000:0.0:1789120959.241317:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120959.241326:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+18:14833:x1876028922373120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120959.241339:0:14829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120959.241350:0:14829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa61d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13cfa3d77faa61cf expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.241373:0:14829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa61d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x13cfa3d77faa61cf expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.241383:0:14829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0d4b000/0x13cfa3d77faa61d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x13cfa3d77faa61cf expref: 19 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.241392:0:14829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b000, rc 0) 00000100:00100000:0.0:1789120959.241436:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922373120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120959.241443:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789120959.241644:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120959.241658:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61d6 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.241667:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x13cfa3d77faa61d6 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120959.241834:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.241862:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.241889:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120959.241927:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373248 00000100:00100000:2.0:1789120959.241931:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373248 00000100:00100000:2.0:1789120959.241958:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789120959.241965:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922373248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.242236:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfbf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922373248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.242260:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789120959.242381:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.242410:0:14833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.242447:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.242469:0:14833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd95431300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120959.242505:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373376 00000100:00100000:2.0:1789120959.242509:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373376 00000100:00100000:2.0:1789120959.242534:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789120959.242540:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922373376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.242662:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:14833:x1876028922373376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.242669:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789120959.242809:0:14833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:663c5952-eef7-4d23-9f6d-c418f8c48dc5:14833:1876028922373376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789120959.243558:0:16995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789120959.243839:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789120959.243856:0:14833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120959.243864:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61d6 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120959.243874:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.109@tcp lock: ffff9ffda0b56c00/0x13cfa3d77faa61cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x13cfa3d77faa61d6 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120959.599674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120959.599726:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409152 00000100:00100000:3.0:1789120959.599737:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409152 00000100:00100000:3.0:1789120959.599794:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:3.0:1789120959.599803:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+11:13975:x1876028901409152:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120959.599827:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120959.599845:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa61dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b1fe expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.599877:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1fe expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.599888:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffd8149b000/0x13cfa3d77faa61dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1fe expref: 12 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120959.599896:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149b000, rc 0) 00000100:00100000:3.0:1789120959.599961:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409152:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.599968:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 114 00000100:00100000:2.0:1789120959.604590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120959.604685:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409280 00000100:00100000:3.0:1789120959.604696:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409280 00000100:00100000:3.0:1789120959.604753:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:3.0:1789120959.604764:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409280:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.605022:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409280:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.605030:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 115 00000100:00100000:2.0:1789120959.618703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120959.620501:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409408 00000100:00100000:0.0:1789120959.620513:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409408 00000100:00100000:0.0:1789120959.622708:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:0.0:1789120959.622725:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409408:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120959.622958:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409408:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 239us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120959.622967:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 116 00000100:00100000:1.0:1789120959.642404:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120959.643246:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409536 00000100:00100000:2.0:1789120959.643257:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409536 00000100:00100000:2.0:1789120959.644113:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:2.0:1789120959.644128:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbfc43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+12:13975:x1876028901409536:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120959.644179:0:14828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120959.644196:0:14828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa61e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b205 expref: -99 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.644225:0:14828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa61e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b205 expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.644236:0:14828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ffda0b56600/0x13cfa3d77faa61e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b205 expref: 13 pid: 14828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120959.644261:0:14828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56600, rc 0) 00000100:00100000:2.0:1789120959.644329:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbfc43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:13975:x1876028901409536:12345-192.168.206.9@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.644337:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 117 00000100:00100000:2.0:1789120959.659370:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120959.659983:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409664 00000100:00100000:3.0:1789120959.659996:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409664 00000100:00100000:3.0:1789120959.660062:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:3.0:1789120959.660072:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:13975:x1876028901409664:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120959.660364:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:13975:x1876028901409664:12345-192.168.206.9@tcp:501:ll_cfg_requeue.0 Request processed in 291us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.660373:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 118 00000100:00100000:2.0:1789120959.665897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120959.667796:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409792 00000100:00100000:3.0:1789120959.667810:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409792 00000100:00100000:2.0:1789120959.672285:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 119 00000100:00100000:2.0:1789120959.672306:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:13975:x1876028901409792:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120959.672546:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:13975:x1876028901409792:12345-192.168.206.9@tcp:503:ll_cfg_requeue.0 Request processed in 247us (6656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120959.672556:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 119 00010000:00010000:0.0:1789120959.722423:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120960.746422:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922373632:0@lo:400:kworker.0 00000100:00100000:0.0:1789120960.746491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120960.746555:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922374144:0@lo:400:kworker.0 00000100:00100000:0.0:1789120960.746581:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120960.746604:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120960.746610:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922373504:0@lo:400:kworker.0 00000100:00100000:0.0:1789120960.746634:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120960.746653:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922374016:0@lo:400:kworker.0 00000100:00100000:0.0:1789120960.746674:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120960.746746:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373632 00000100:00100000:1.0:1789120960.746754:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373632 00000100:00100000:1.0:1789120960.746808:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120960.746818:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.746884:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922373632:12345-0@lo:400:kworker.0 Request processed in 68us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120960.746893:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120960.746917:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922374144 00000100:00100000:1.0:1789120960.746920:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922374144 00000100:00100000:1.0:1789120960.746950:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922374016 00000100:00100000:1.0:1789120960.746953:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922374016 00000100:00100000:1.0:1789120960.746975:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789120960.746983:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922374144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.747018:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876028922374144:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120960.747020:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120960.747035:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922374016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.747049:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120960.747081:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc834612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922374016:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120960.747090:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120960.747114:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922374016:0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.747140:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922373632:0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.747174:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876028922374144:0@lo:400:kworker.0 00000100:00100000:2.0:1789120960.747414:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922373760:0@lo:400:kworker.0 00000100:00100000:2.0:1789120960.747446:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120960.747463:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922374272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120960.747484:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120960.747510:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120960.747516:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922373888:0@lo:400:kworker.0 00000100:00100000:2.0:1789120960.747538:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120960.747580:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373504 00000100:00100000:2.0:1789120960.747585:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373504 00000100:00100000:3.0:1789120960.747590:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373888 00000100:00100000:3.0:1789120960.747596:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373888 00000100:00100000:2.0:1789120960.747620:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789120960.747630:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922373504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120960.747643:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120960.747651:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922373888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120960.747692:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876028922373888:12345-0@lo:400:kworker.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120960.747706:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120960.747740:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876028922373888:0@lo:400:kworker.0 00000100:00080000:3.0:1789120960.747765:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120960.747807:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922373760 00000100:00100000:0.0:1789120960.747811:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922373760 00000100:00100000:0.0:1789120960.747859:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789120960.747866:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120960.747906:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922373760:12345-0@lo:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120960.747912:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789120960.747945:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922373760:0@lo:400:kworker.0 00000100:00100000:2.0:1789120960.748091:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922373504:12345-0@lo:400:kworker.0 Request processed in 463us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120960.748105:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:2.0:1789120960.748196:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120960.748261:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922373504:0@lo:400:kworker.0 00000100:00100000:1.0:1789120960.748325:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922374272 00000100:00100000:1.0:1789120960.748330:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922374272 00000100:00100000:1.0:1789120960.748366:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120960.748374:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922374272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120960.748400:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120960.748446:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922374272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120960.748452:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789120960.748532:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922374272:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789120960.748594:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789120961.771568:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120961.794309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120961.794443:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901409920 00000100:00100000:1.0:1789120961.794455:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901409920 00000100:00100000:1.0:1789120961.794545:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789120961.794558:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:14636:x1876028901409920:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120961.794597:0:16250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789120961.794600:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789120961.794634:0:16250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa61eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b20c expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794790:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794811:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794826:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794848:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794855:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.794863:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.795503:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa6200 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.795517:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa6200 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.795526:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa6200 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120961.795610:0:16250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789120961.795621:0:16250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120961.796901:0:16250:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa6200 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796926:0:16250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796933:0:16250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796942:0:16250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796949:0:16250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120961.796954:0:16250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796962:0:16250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796979:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:0.0:1789120961.796983:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120961.796988:0:16250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.796995:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa61f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797009:0:16250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797016:0:16250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797034:0:16250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797040:0:16250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120961.797043:0:16250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797050:0:16250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797059:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ffd9fd7c900) 00010000:00010000:0.0:1789120961.797062:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120961.797064:0:16250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797071:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa61f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797576:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba800/0x13cfa3d77faa61eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b20c expref: 8 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797597:0:16250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4b200/0x13cfa3d77faa6200 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b20c expref: 7 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.797606:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:0.0:1789120961.797609:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120961.797611:0:16250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4b200, rc 0) 00000100:00100000:0.0:1789120961.797889:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14636:x1876028901409920:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 3331us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.797912:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789120961.801918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120961.802199:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410176 00000100:00100000:3.0:1789120961.802211:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410176 00000100:00100000:3.0:1789120961.802274:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120961.802286:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14636:x1876028901410176:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120961.802314:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120961.802343:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6207 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b213 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802452:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802469:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802486:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802668:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802691:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.802723:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.804283:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a200/0x13cfa3d77faa621c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.804300:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a200/0x13cfa3d77faa621c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.804310:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a200/0x13cfa3d77faa621c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120961.804328:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789120961.805631:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805644:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805651:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805657:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149be00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120961.805661:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805669:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805684:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ffd9fd7c200) 00010000:00010000:3.0:1789120961.805688:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120961.805700:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805707:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa620e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805720:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805725:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805731:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805736:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120961.805739:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805744:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805752:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ffd82ac2d00) 00010000:00010000:3.0:1789120961.805755:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120961.805757:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.805764:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6215 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.808401:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6207 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b213 expref: 10 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.810386:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a200/0x13cfa3d77faa621c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b213 expref: 9 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120961.810401:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd82ac2900) 00010000:00010000:3.0:1789120961.810404:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120961.810407:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a200, rc 0) 00000100:00100000:3.0:1789120961.810550:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14636:x1876028901410176:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 8265us (8645us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789120961.810559:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:2.0:1789120961.816783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120961.822920:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410304 00000100:00100000:3.0:1789120961.822943:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410304 00000100:00100000:3.0:1789120961.823024:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:3.0:1789120961.823037:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14636:x1876028901410304:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789120961.827776:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14636:x1876028901410304:12345-192.168.206.9@tcp:59:lhsmtool_posix.0 Request processed in 4722us (10995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120961.827795:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:1.0:1789120961.871071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120961.871370:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410432 00000100:00100000:2.0:1789120961.871383:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410432 00000100:00100000:2.0:1789120961.871762:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789120961.871826:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14642:x1876028901410432:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120961.871852:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120961.871879:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa622a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b21a expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.871956:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.871973:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.871986:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872003:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872010:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872037:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872798:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872811:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872819:0:14837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872826:0:14837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120961.872831:0:14837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872840:0:14837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872855:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:2.0:1789120961.872859:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120961.872864:0:14837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872870:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872885:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872891:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872904:0:14837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872910:0:14837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120961.872913:0:14837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872919:0:14837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872926:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffd831cf600) 00010000:00010000:2.0:1789120961.872928:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120961.872930:0:14837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872936:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa6238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872980:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa622a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b21a expref: 10 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.872991:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:2.0:1789120961.872993:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120961.872996:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa622a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b21a expref: 10 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.873007:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57600, rc 0) 00000100:00100000:2.0:1789120961.873329:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14642:x1876028901410432:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1554us (2275us total) trans 0 rc 301/301 00000100:00100000:2.0:1789120961.873360:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:3.0:1789120961.878388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120961.879408:0:14844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410560 00000100:00100000:0.0:1789120961.879422:0:14844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410560 00000100:00100000:0.0:1789120961.879540:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789120961.879552:0:14844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14642:x1876028901410560:12345-192.168.206.9@tcp:700:lfs.0 00000100:00100000:0.0:1789120961.879680:0:14844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd906412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14642:x1876028901410560:12345-192.168.206.9@tcp:700:lfs.0 Request processed in 130us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.879688:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789120961.901059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120961.901191:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410816 00000100:00100000:0.0:1789120961.901204:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410816 00000100:00100000:0.0:1789120961.901278:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 19 00000100:00100000:0.0:1789120961.901290:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14642:x1876028901410816:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:0.0:1789120961.901861:0:16250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120961.901896:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa616d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b195 expref: 9 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.901920:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:0.0:1789120961.901925:0:16250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120961.903194:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.903222:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 5 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.903232:0:16250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.903290:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 5 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.903309:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 5 pid: 14837 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120961.903327:0:16250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16250:1876028922374400:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120961.903471:0:16250:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120961.907002:0:16250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd989743c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16250:1876028922374400:192.168.206.9@tcp:104: 00010000:00010000:0.0:1789120961.907042:0:16250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120961.908857:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120961.909051:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901410944 00000100:00100000:0.0:1789120961.909063:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901410944 00010000:00010000:0.0:1789120961.909162:0:14822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 6 pid: 14837 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789120961.909284:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120961.909334:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:0.0:1789120961.909346:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:2350:x1876028901410944:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120961.909365:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120961.909373:0:14822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 6 pid: 14837 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909387:0:14822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 6 pid: 14837 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909431:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa61a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b1f7 expref: 6 pid: 14837 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909450:0:14822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:0.0:1789120961.909457:0:14822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909468:0:14822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909476:0:14822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120961.909520:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120961.909597:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2350:x1876028901410944:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 252us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.909606:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00010000:00010000:1.0:1789120961.909679:0:16250:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.909688:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.909719:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.909729:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.909741:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120961.911325:0:16250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789120961.911345:0:16250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911355:0:16250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911363:0:16250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911369:0:16250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120961.911374:0:16250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911383:0:16250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911398:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffda3a2ac00) 00010000:00010000:1.0:1789120961.911409:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120961.911415:0:16250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120961.911422:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa623f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120961.911445:0:16250:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004e92224f reply state 0000000032b8f21c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120961.911454:0:16250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120961.911551:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+10:14642:x1876028901410816:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 10260us (10503us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789120961.911560:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 19 00010000:00010000:2.0:1789120961.914331:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914353:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914361:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914368:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120961.914373:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914381:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914400:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffda3a2a600) 00010000:00010000:2.0:1789120961.914403:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120961.914409:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120961.914416:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa6246 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120961.975274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120961.975323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120961.975362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120961.975378:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120961.975392:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411328 00000100:00100000:1.0:1789120961.975402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120961.975404:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411328 00000100:00100000:1.0:1789120961.975425:0:16875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411584 00000100:00100000:1.0:1789120961.975428:0:16875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411584 00000100:00100000:1.0:1789120961.975471:0:16875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411200 00000100:00100000:1.0:1789120961.975474:0:16875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411200 00000100:00100000:1.0:1789120961.975488:0:16875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411456 00000100:00100000:1.0:1789120961.975490:0:16875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411456 00000100:00100000:1.0:1789120961.975511:0:16875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120961.975567:0:14828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411072 00000100:00100000:2.0:1789120961.975571:0:14828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411072 00000100:00100000:2.0:1789120961.975605:0:14828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00100000:2.0:1789120961.975614:0:14828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2351:x1876028901411072:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:2.0:1789120961.975702:0:14828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe626eda-eaae-41e0-a095-c0f5c3ffcaa9+13:2351:x1876028901411072:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 89us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120961.975727:0:14828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 121 00000100:00080000:2.0:1789120961.975875:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120961.975880:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120961.975926:0:16875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901411584:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:1.0:1789120961.975977:0:16875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901411584:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 458us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.980343:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:3.0:1789120961.980366:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901411200:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120961.981281:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901411200:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 916us (5891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.981294:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:3.0:1789120961.981329:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789120961.981339:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901411456:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120961.981394:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:2351:x1876028901411456:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 58us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.981401:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:3.0:1789120961.981415:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:3.0:1789120961.981422:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901411328:12345-192.168.206.9@tcp:400:kworker.0 00000100:00100000:3.0:1789120961.981461:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2351:x1876028901411328:12345-192.168.206.9@tcp:400:kworker.0 Request processed in 40us (6138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.981468:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:1.0:1789120961.985518:0:16875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120962.044833:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.044941:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411712 00000100:00100000:3.0:1789120962.044954:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411712 00000100:00100000:3.0:1789120962.045038:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120962.045051:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14650:x1876028901411712:12345-192.168.206.9@tcp:101:lctl.0 00010000:00010000:3.0:1789120962.045092:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120962.045130:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa624d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b221 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045254:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6254 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045271:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045284:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120962.045355:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789120962.045360:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120962.045432:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6254 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045463:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa624d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b221 expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045483:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149ba00/0x13cfa3d77faa6254 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b221 expref: 10 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.045492:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:3.0:1789120962.045496:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120962.045500:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149ba00, rc 0) 00000100:00100000:3.0:1789120962.045579:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+10:14650:x1876028901411712:12345-192.168.206.9@tcp:101:lctl.0 Request processed in 531us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120962.045587:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 20 00000100:00100000:3.0:1789120962.070608:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.071447:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411840 00000100:00100000:2.0:1789120962.071463:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411840 00000100:00100000:2.0:1789120962.071548:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:2.0:1789120962.071560:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+5:14651:x1876028901411840:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120962.071586:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.071612:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa625b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b228 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071690:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57c00/0x13cfa3d77faa6262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071706:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57c00/0x13cfa3d77faa6262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071719:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57c00/0x13cfa3d77faa6262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.071793:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789120962.071797:0:14836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120962.071827:0:14836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57c00/0x13cfa3d77faa6262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071853:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa625b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b228 expref: 7 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071873:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57c00/0x13cfa3d77faa6262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b228 expref: 6 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.071898:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.071901:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120962.071905:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57c00, rc 0) 00000100:00100000:2.0:1789120962.071991:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90640780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14651:x1876028901411840:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 433us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.071998:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 21 00000100:00100000:1.0:1789120962.076461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.076562:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901411968 00000100:00100000:3.0:1789120962.076575:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901411968 00000100:00100000:3.0:1789120962.076643:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:3.0:1789120962.076654:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+6:14651:x1876028901411968:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120962.076678:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120962.076703:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b22f expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076783:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076801:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076835:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076853:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076861:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.076867:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077372:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077396:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077409:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120962.077472:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789120962.077476:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120962.077501:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077514:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077520:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077542:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077548:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120962.077552:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077559:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077571:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:3.0:1789120962.077574:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120962.077578:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077585:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa6270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077602:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077608:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077615:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077679:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149be00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120962.077682:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077698:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077706:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffd82ac2e00) 00010000:00010000:3.0:1789120962.077708:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120962.077711:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077717:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077753:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b22f expref: 8 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077766:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b22f expref: 7 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.077773:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2000) 00010000:00010000:3.0:1789120962.077775:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120962.077777:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a000, rc 0) 00000100:00100000:3.0:1789120962.077922:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+7:14651:x1876028901411968:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 1269us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120962.077938:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 22 00000100:00100000:3.0:1789120962.081873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.081998:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901412224 00000100:00100000:2.0:1789120962.082012:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901412224 00000100:00100000:2.0:1789120962.082091:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:2.0:1789120962.082103:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+7:14651:x1876028901412224:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120962.082139:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.082205:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b236 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.082497:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789120962.082646:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6285 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b236 expref: 9 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.082662:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.082665:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120962.082670:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa6285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b236 expref: 9 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.082686:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57800, rc 0) 00000100:00100000:2.0:1789120962.082763:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+8:14651:x1876028901412224:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 662us (904us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789120962.082791:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 23 00000100:00100000:1.0:1789120962.085919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.085997:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901412480 00000100:00100000:2.0:1789120962.086010:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901412480 00000100:00100000:2.0:1789120962.086074:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 24 00000100:00100000:2.0:1789120962.086084:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+8:14651:x1876028901412480:12345-192.168.206.9@tcp:36:lfs.0 00010000:00010000:2.0:1789120962.086176:0:14837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.086201:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa627e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b22f expref: 8 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.086223:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2000) 00010000:00010000:2.0:1789120962.086233:0:14837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120962.086257:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.086268:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.086277:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120962.086485:0:14837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ced40fd0 reply state 00000000660b0420 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120962.086495:0:14837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789120962.086508:0:14837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789120962.086593:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f36552f-038e-4e0c-927f-25dfe7787a8b+9:14651:x1876028901412480:12345-192.168.206.9@tcp:36:lfs.0 Request processed in 509us (686us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789120962.086601:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 24 00010000:00010000:0.0:1789120962.090906:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.090924:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.090933:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.090940:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120962.090946:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.090974:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.090993:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd831cf600) 00010000:00010000:0.0:1789120962.090997:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789120962.091002:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.091008:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56e00/0x13cfa3d77faa6293 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.091218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.091432:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901412736 00000100:00100000:0.0:1789120962.091441:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901412736 00000100:00100000:0.0:1789120962.091503:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789120962.091515:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+8:14651:x1876028901412736:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:0.0:1789120962.091921:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+9:14651:x1876028901412736:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 406us (706us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789120962.091932:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:3.0:1789120962.096077:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.096195:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901412992 00000100:00100000:2.0:1789120962.096205:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901412992 00000100:00100000:2.0:1789120962.096268:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 25 00000100:00100000:2.0:1789120962.096278:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+9:14651:x1876028901412992:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120962.096300:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.096319:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa629a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b23d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096389:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096403:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096415:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096431:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096438:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096445:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.096570:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789120962.096646:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096654:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096677:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096683:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120962.096687:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096695:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096706:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.096709:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120962.096713:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096719:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096732:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096738:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096744:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096749:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120962.096752:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096766:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096773:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffd831cf700) 00010000:00010000:2.0:1789120962.096775:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120962.096777:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096783:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096818:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa629a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b23d expref: 11 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096827:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.096829:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120962.096832:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa629a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b23d expref: 11 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.096841:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57a00, rc 0) 00000100:00100000:2.0:1789120962.096886:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90641a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+10:14651:x1876028901412992:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 610us (818us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789120962.096894:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 25 00000040:00080000:1.0:1789120962.098415:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789120962.109237:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.109448:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901413120 00000100:00100000:3.0:1789120962.109459:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901413120 00000100:00100000:3.0:1789120962.109534:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:3.0:1789120962.109544:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd989743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+10:14651:x1876028901413120:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:3.0:1789120962.109568:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120962.109591:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa62b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b244 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109669:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109683:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109694:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120962.109738:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789120962.109742:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789120962.109764:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109789:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa62b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 12 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109806:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.109814:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2e00) 00010000:00010000:3.0:1789120962.109817:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120962.109820:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a800, rc 0) 00000100:00100000:3.0:1789120962.109885:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd989743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+11:14651:x1876028901413120:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 343us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120962.109898:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 26 00000100:00100000:3.0:1789120962.116312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.116388:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901413248 00000100:00100000:0.0:1789120962.116402:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901413248 00000100:00100000:0.0:1789120962.116476:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:0.0:1789120962.116486:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+11:14651:x1876028901413248:12345-192.168.206.9@tcp:37:lfs.0 00000100:00100000:0.0:1789120962.125739:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+11:14651:x1876028901413248:12345-192.168.206.9@tcp:37:lfs.0 Request processed in 9243us (9430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120962.125753:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:1.0:1789120962.138979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.139096:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901413504 00000100:00100000:3.0:1789120962.139108:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901413504 00000100:00100000:3.0:1789120962.139480:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789120962.139494:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc8182a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+11:14651:x1876028901413504:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120962.139823:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc8182a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f36552f-038e-4e0c-927f-25dfe7787a8b+12:14651:x1876028901413504:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 331us (858us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789120962.139831:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:3.0:1789120962.194793:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.195451:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901413632 00000100:00100000:2.0:1789120962.195464:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901413632 00000100:00100000:2.0:1789120962.195819:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:2.0:1789120962.195830:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+10:14657:x1876028901413632:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:2.0:1789120962.195868:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.195891:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa62c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b24b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.195952:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.195965:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.195975:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.195989:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.195995:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196001:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196100:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa62d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196109:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196126:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.196191:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789120962.196201:0:14836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120962.196697:0:14836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196712:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196718:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196724:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196729:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120962.196734:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196740:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196752:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.196755:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120962.196760:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196765:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56400/0x13cfa3d77faa62cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196780:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196785:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196803:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196809:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b56200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120962.196812:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196818:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196829:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ffd831cf700) 00010000:00010000:2.0:1789120962.196832:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120962.196835:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196840:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa62d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196872:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa62c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b24b expref: 12 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196886:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57800/0x13cfa3d77faa62d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b24b expref: 11 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.196893:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2e00) 00010000:00010000:2.0:1789120962.196895:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789120962.196897:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57800, rc 0) 00000100:00100000:2.0:1789120962.196971:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+11:14657:x1876028901413632:12345-192.168.206.9@tcp:101:bash.0 Request processed in 1143us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.196987:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 27 00000100:00100000:1.0:1789120962.200394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.200512:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901413888 00000100:00100000:3.0:1789120962.200523:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901413888 00000100:00100000:3.0:1789120962.200592:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 28 00000100:00100000:3.0:1789120962.200664:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+11:14657:x1876028901413888:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:3.0:1789120962.200693:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120962.200721:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa62e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b252 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.200884:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.200900:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.200910:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.200970:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 11 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.200986:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 11 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.201002:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374528:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120962.201438:0:14835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3fd6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120962.207224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.207330:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901414016 00000100:00100000:0.0:1789120962.207359:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901414016 00010000:00010000:0.0:1789120962.207415:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 12 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120962.207470:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:0.0:1789120962.207481:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+12:2349:x1876028901414016:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120962.207499:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120962.207507:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 12 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.207524:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 12 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.207552:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2e00) 00010000:00010000:0.0:1789120962.207559:0:14821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.207570:0:14821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.207578:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.207600:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120962.207669:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f36552f-038e-4e0c-927f-25dfe7787a8b+12:2349:x1876028901414016:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 190us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120962.207678:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00010000:00010000:3.0:1789120962.207847:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa62bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b244 expref: 11 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.207867:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd90642d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374528:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120962.207897:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.207907:0:14835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.207913:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.207940:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.207951:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.207959:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208850:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208864:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208874:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120962.208886:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789120962.208920:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208927:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208935:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208941:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149be00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120962.208946:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208954:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208966:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2e00) 00010000:00010000:3.0:1789120962.208970:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120962.208975:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.208995:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa62e7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120962.209009:0:14835:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d0098004 reply state 00000000699ff149 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.209018:0:14835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789120962.209056:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa62e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 14 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.209071:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 13 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.209080:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:3.0:1789120962.209082:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789120962.209085:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149a000, rc 0) 00000100:00100000:3.0:1789120962.209184:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14657:x1876028901413888:12345-192.168.206.9@tcp:101:bash.0 Request processed in 8583us (8803us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789120962.209193:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 28 00010000:00010000:2.0:1789120962.211260:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211280:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211288:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211294:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120962.211304:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211313:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211331:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ffd82ac2700) 00010000:00010000:2.0:1789120962.211334:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120962.211339:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.211346:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149aa00/0x13cfa3d77faa62ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120962.227990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.228109:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901414144 00000100:00100000:0.0:1789120962.228129:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901414144 00000100:00100000:0.0:1789120962.228248:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789120962.228259:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+13:14657:x1876028901414144:12345-192.168.206.9@tcp:101:bash.0 00010000:00010000:0.0:1789120962.228289:0:16250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120962.228312:0:16250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6303 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b259 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228393:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228410:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228424:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120962.228471:0:16250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789120962.228476:0:16250:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120962.228501:0:16250:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228514:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228540:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6303 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 15 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228560:0:16250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 14 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.228569:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:0.0:1789120962.228579:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120962.228584:0:16250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ae00, rc 0) 00000100:00100000:0.0:1789120962.228646:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14657:x1876028901414144:12345-192.168.206.9@tcp:101:bash.0 Request processed in 389us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120962.228654:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 29 00000100:00100000:0.0:1789120962.232529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.232644:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901414400 00000100:00100000:2.0:1789120962.232655:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901414400 00000100:00100000:2.0:1789120962.232731:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:2.0:1789120962.232743:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14657:x1876028901414400:12345-192.168.206.9@tcp:35:bash.0 00000100:00100000:2.0:1789120962.234382:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+15:14657:x1876028901414400:12345-192.168.206.9@tcp:35:bash.0 Request processed in 1630us (1855us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789120962.234415:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120962.303984:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.304127:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901414656 00000100:00100000:2.0:1789120962.304140:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901414656 00000100:00100000:2.0:1789120962.304990:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:2.0:1789120962.305003:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+15:14667:x1876028901414656:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:2.0:1789120962.305036:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.305061:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b260 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.305264:0:14837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789120962.305426:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6311 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b260 expref: 17 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.305451:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ffd82ac2d00) 00010000:00010000:2.0:1789120962.305454:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120962.305461:0:14837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b260 expref: 17 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.305479:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57a00, rc 0) 00000100:00100000:2.0:1789120962.305561:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+16:14667:x1876028901414656:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 560us (1591us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789120962.305569:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 30 00000100:00100000:1.0:1789120962.309467:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.309750:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901414912 00000100:00100000:2.0:1789120962.309761:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901414912 00000100:00100000:2.0:1789120962.309859:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:2.0:1789120962.309869:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+16:14667:x1876028901414912:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:2.0:1789120962.310219:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+17:14667:x1876028901414912:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 351us (1084us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789120962.310234:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:0.0:1789120962.342219:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120962.343540:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901415168 00000100:00100000:1.0:1789120962.343556:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901415168 00000100:00100000:1.0:1789120962.343641:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789120962.343653:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+17:14670:x1876028901415168:12345-192.168.206.9@tcp:101:lfs.0 00010000:00010000:1.0:1789120962.343871:0:16250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120962.343898:0:16250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa631f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b267 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120962.344038:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa6326 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120962.344056:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa6326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120962.344070:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa6326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120962.344084:0:16250:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789120962.344295:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb200/0x13cfa3d77faa631f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b267 expref: 20 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120962.344342:0:16250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa6326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b267 expref: 19 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120962.344350:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:1.0:1789120962.344354:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120962.344358:0:16250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bae00, rc 0) 00000100:00100000:1.0:1789120962.344643:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14670:x1876028901415168:12345-192.168.206.9@tcp:101:lfs.0 Request processed in 991us (2437us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789120962.344652:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 31 00000100:00100000:1.0:1789120962.349940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.350048:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901415296 00000100:00100000:3.0:1789120962.350061:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901415296 00000100:00100000:3.0:1789120962.350140:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:3.0:1789120962.350189:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14670:x1876028901415296:12345-192.168.206.9@tcp:54:lfs.0 00010000:00010000:3.0:1789120962.350275:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350295:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350328:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350362:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350371:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350378:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350398:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120962.350403:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350410:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350424:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:3.0:1789120962.350428:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120962.350434:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.350441:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6334 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.350538:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14670:x1876028901415296:12345-192.168.206.9@tcp:54:lfs.0 Request processed in 352us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120962.350547:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 32 00000100:00100000:0.0:1789120962.354350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.354501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.355004:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901415680 00000100:00100000:3.0:1789120962.355017:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901415680 00000100:00100000:3.0:1789120962.355089:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:3.0:1789120962.355101:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14670:x1876028901415680:12345-192.168.206.9@tcp:35:lfs.0 00000100:00100000:3.0:1789120962.355472:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+20:14670:x1876028901415680:12345-192.168.206.9@tcp:35:lfs.0 Request processed in 363us (959us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789120962.355481:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789120962.356594:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901415424 00000100:00100000:2.0:1789120962.356606:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901415424 00000100:00100000:2.0:1789120962.356900:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:2.0:1789120962.356913:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+20:2349:x1876028901415424:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120962.356931:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.356962:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bae00/0x13cfa3d77faa6326 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b267 expref: 20 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.356985:0:14822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.356991:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120962.357053:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:2349:x1876028901415424:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 144us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.357061:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789120962.572178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.572504:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901415936 00000100:00100000:2.0:1789120962.572524:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901415936 00000100:00100000:2.0:1789120962.572625:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:2.0:1789120962.572637:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14701:x1876028901415936:12345-192.168.206.9@tcp:101:cat.0 00010000:00010000:2.0:1789120962.572670:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.572698:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa633b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b26e expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.573136:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa6342 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.573205:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa6342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.573219:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa6342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120962.573236:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789120962.573442:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa633b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b26e expref: 22 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.573468:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa6342 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b26e expref: 21 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.573478:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.573480:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120962.573484:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56200, rc 0) 00000100:00100000:2.0:1789120962.573569:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:14701:x1876028901415936:12345-192.168.206.9@tcp:101:cat.0 Request processed in 934us (1436us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789120962.573577:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 33 00000100:00100000:3.0:1789120962.579131:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.579202:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901416064 00000100:00100000:2.0:1789120962.579215:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901416064 00000100:00100000:3.0:1789120962.579240:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.579288:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:2.0:1789120962.579300:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:2349:x1876028901416064:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120962.579321:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.579352:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa6342 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b26e expref: 21 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120962.580261:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901416320 00000100:00100000:0.0:1789120962.580273:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901416320 00000100:00100000:0.0:1789120962.580339:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 8 00000100:00100000:0.0:1789120962.580350:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+22:14701:x1876028901416320:12345-192.168.206.9@tcp:35:cat.0 00000100:00100000:0.0:1789120962.582371:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90643840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:14701:x1876028901416320:12345-192.168.206.9@tcp:35:cat.0 Request processed in 2012us (3118us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789120962.582387:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 8 00010000:00010000:2.0:1789120962.583789:0:14820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.583795:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120962.584283:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:2349:x1876028901416064:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 4980us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.584296:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789120962.669380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120962.669657:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901416576 00000100:00100000:3.0:1789120962.669679:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901416576 00000100:00100000:3.0:1789120962.669755:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:3.0:1789120962.669766:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:14707:x1876028901416576:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:3.0:1789120962.669797:0:14835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120962.669822:0:14835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6350 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b275 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.669967:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.669984:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.669994:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 22 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.670004:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.670063:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 22 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.670079:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 22 pid: 16250 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.670095:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffc83460780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374656:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120962.670442:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.670454:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.670465:0:14835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb54df0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374784:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120962.670493:0:14835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3fd6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120962.675135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.675369:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901416704 00000100:00100000:2.0:1789120962.675380:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901416704 00010000:00010000:2.0:1789120962.675432:0:14822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 23 pid: 16250 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120962.675479:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:2.0:1789120962.675490:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdbab6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:2350:x1876028901416704:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120962.675509:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.675518:0:14822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 23 pid: 16250 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.675533:0:14822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 23 pid: 16250 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.675986:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffc83460780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374656:192.168.206.9@tcp:104: 00000100:00100000:3.0:1789120962.676001:0:14835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb54df0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14835:1876028922374784:192.168.206.9@tcp:104: 00010000:00010000:2.0:1789120962.676060:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa630a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b259 expref: 23 pid: 16250 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.677282:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.677344:0:14822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.677351:0:14822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.677384:0:14822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.677392:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120962.677562:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdbab6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+22:2350:x1876028901416704:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 2070us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.677574:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:0.0:1789120962.689536:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.689699:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901416832 00000100:00100000:2.0:1789120962.689711:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901416832 00010000:00010000:2.0:1789120962.689761:0:14820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120962.689810:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120962.689821:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+22:2350:x1876028901416832:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120962.689839:0:14820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.689858:0:14820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.689873:0:14820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.689900:0:14820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a000/0x13cfa3d77faa62f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b252 expref: 22 pid: 14835 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.689918:0:14820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.689924:0:14820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.689953:0:14820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.689961:0:14820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.690001:0:14820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120962.690069:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:2350:x1876028901416832:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 249us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.690078:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00010000:00010000:3.0:1789120962.690296:0:14835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.690305:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120962.690339:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789120962.690540:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6350 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b275 expref: 22 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.690557:0:14835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149be00/0x13cfa3d77faa6357 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b275 expref: 21 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120962.690565:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:3.0:1789120962.690568:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120962.690571:0:14835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149be00, rc 0) 00000100:00100000:3.0:1789120962.690604:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:14707:x1876028901416576:12345-192.168.206.9@tcp:101:dd.0 Request processed in 20840us (21239us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789120962.690612:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 34 00000100:00100000:1.0:1789120962.694647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120962.699378:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417088 00000100:00100000:0.0:1789120962.699396:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417088 00000100:00100000:0.0:1789120962.699544:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 35 00000100:00100000:0.0:1789120962.699568:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:14707:x1876028901417088:12345-192.168.206.9@tcp:36:dd.0 00010000:00010000:0.0:1789120962.699941:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.699961:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.699999:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120962.700064:0:16250:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789120962.700097:0:16250:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b983297a reply state 000000002a674ff4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120962.700107:0:16250:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120962.700296:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14707:x1876028901417088:12345-192.168.206.9@tcp:36:dd.0 Request processed in 729us (5660us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789120962.700308:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 35 00000020:00080000:0.0:1789120962.700315:0:16250:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120962.712740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.712928:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417216 00000100:00100000:2.0:1789120962.712941:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417216 00000100:00100000:2.0:1789120962.713017:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 36 00000100:00100000:2.0:1789120962.713031:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14707:x1876028901417216:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:0.0:1789120962.713033:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.713047:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.713055:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.713062:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4ae00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120962.713067:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.713070:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120962.713078:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.713096:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa636c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b27c expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120962.713099:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:0.0:1789120962.713106:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120962.713167:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.713215:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa636c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b27c expref: 25 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.713231:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa636c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b27c expref: 25 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.713252:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.713255:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120962.713258:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56200, rc 0) 00000100:00100000:2.0:1789120962.713333:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+25:14707:x1876028901417216:12345-192.168.206.9@tcp:101:dd.0 Request processed in 305us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.713341:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 36 00010000:00010000:0.0:1789120962.713466:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa6365 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120962.738816:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.739582:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417472 00000100:00100000:2.0:1789120962.739597:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417472 00000100:00100000:2.0:1789120962.739792:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:2.0:1789120962.739806:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14707:x1876028901417472:12345-192.168.206.9@tcp:103:dd.0 00010000:00010000:2.0:1789120962.739828:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120962.739862:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa636c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b27c expref: 24 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.739891:0:14822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.739966:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120962.740047:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:14707:x1876028901417472:12345-192.168.206.9@tcp:103:dd.0 Request processed in 245us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.740057:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:1.0:1789120962.742595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.743029:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417600 00000100:00100000:2.0:1789120962.743042:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417600 00000100:00100000:2.0:1789120962.743126:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:2.0:1789120962.743140:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:14707:x1876028901417600:12345-192.168.206.9@tcp:58:dd.0 00010000:00010000:2.0:1789120962.743292:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.743313:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.743327:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120962.755574:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120962.765025:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789120962.765209:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789120962.765396:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:14707:x1876028901417600:12345-192.168.206.9@tcp:58:dd.0 Request processed in 22249us (22807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.765413:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 37 00000100:00100000:1.0:1789120962.775528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120962.775861:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417728 00000100:00100000:2.0:1789120962.775874:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417728 00000100:00100000:2.0:1789120962.775955:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 38 00000100:00100000:2.0:1789120962.775967:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:14707:x1876028901417728:12345-192.168.206.9@tcp:101:dd.0 00010000:00010000:2.0:1789120962.775997:0:14837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120962.776025:0:14837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b283 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776099:0:14837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776122:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 24 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776420:0:14837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776437:0:14837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 24 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776454:0:14837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120962.776474:0:14837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120962.776479:0:14837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 24 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120962.776550:0:14837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b56200, rc 0) 00000100:00100000:2.0:1789120962.776712:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14707:x1876028901417728:12345-192.168.206.9@tcp:101:dd.0 Request processed in 746us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.776722:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 38 00010000:00010000:2.0:1789120962.796193:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120963.114692:0:14869:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789120963.114703:0:14869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120963.114772:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789120963.114780:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789120963.118486:0:14869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14869:1876028922374912:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789120963.118747:0:14869:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd81377000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120963.127562:0:14869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14869:1876028922374912:192.168.206.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789120963.132344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.132540:0:14846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417856 00000100:00100000:0.0:1789120963.132573:0:14846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417856 00000100:00100000:0.0:1789120963.132658:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:0.0:1789120963.132671:0:14846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901417856:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789120963.132794:0:14846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901417856:12345-192.168.206.9@tcp:900:lhsmtool_posix.0 Request processed in 126us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120963.132802:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00080000:2.0:1789120963.133017:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120963.147636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.147722:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901417984 00000100:00100000:1.0:1789120963.147734:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901417984 00000100:00100000:1.0:1789120963.147807:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:1.0:1789120963.147835:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901417984:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120963.147877:0:16250:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120963.148016:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901417984:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 184us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.148024:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 39 00000100:00100000:1.0:1789120963.156334:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120963.156442:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901418112 00000100:00100000:3.0:1789120963.156455:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901418112 00000100:00100000:3.0:1789120963.156541:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:3.0:1789120963.156551:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901418112:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789120963.156645:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.156666:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.156681:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.157096:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.157476:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.157491:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157674:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157685:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157692:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120963.157735:0:14835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789120963.157740:0:14835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789120963.157755:0:14835:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157766:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157772:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157790:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157796:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120963.157799:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157806:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157817:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd82ac2900) 00010000:00010000:2.0:1789120963.157820:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120963.157825:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157831:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a600/0x13cfa3d77faa6381 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157846:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157852:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157857:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157862:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120963.157865:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157880:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157888:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ffd82ac2100) 00010000:00010000:2.0:1789120963.157891:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120963.157893:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157899:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa6388 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157912:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157918:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157923:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157928:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120963.157931:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157937:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157944:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:2.0:1789120963.157946:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120963.157949:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.157964:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa638f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.159576:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901418112:12345-192.168.206.9@tcp:34:lhsmtool_posix.0 Request processed in 3017us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.159589:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 40 00000100:00100000:2.0:1789120963.169929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120963.170030:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901418368 00000100:00100000:3.0:1789120963.170040:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901418368 00000100:00100000:3.0:1789120963.170100:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789120963.170117:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:14709:x1876028901418368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120963.170137:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120963.170190:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149bc00/0x13cfa3d77faa6396 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b28a expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170288:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170462:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170475:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120963.170487:0:14836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789120963.170587:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170595:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170618:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170625:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120963.170629:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170637:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170647:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:3.0:1789120963.170650:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789120963.170655:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170672:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149a800/0x13cfa3d77faa639d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170709:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149bc00/0x13cfa3d77faa6396 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b28a expref: 26 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170718:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ffd82ac2900) 00010000:00010000:3.0:1789120963.170721:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120963.170724:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd8149bc00/0x13cfa3d77faa6396 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b28a expref: 26 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.170733:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffd8149bc00, rc 0) 00000100:00100000:3.0:1789120963.170789:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+25:14709:x1876028901418368:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 681us (867us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789120963.170807:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 41 00000100:00100000:3.0:1789120963.173361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.176814:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901418496 00000100:00100000:2.0:1789120963.176827:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901418496 00000100:00100000:2.0:1789120963.176944:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:2.0:1789120963.176955:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+25:14709:x1876028901418496:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120963.176989:0:14837:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120963.177122:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+25:14709:x1876028901418496:12345-192.168.206.9@tcp:53:lhsmtool_posix.0 Request processed in 161us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.177130:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 42 00000100:00100000:1.0:1789120963.189653:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.190861:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901418752 00000100:00100000:0.0:1789120963.190873:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901418752 00000100:00100000:0.0:1789120963.190936:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:0.0:1789120963.190945:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+25:14709:x1876028901418752:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120963.190965:0:16250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120963.190985:0:16250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa63ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b291 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789120963.192430:0:16250:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1789120963.192440:0:16250:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789120963.192491:0:16250:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789120963.192820:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.192836:0:16250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.192854:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16250 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.192912:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa63ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b291 expref: 28 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.192930:0:16250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b291 expref: 27 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.192939:0:16250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd9fd7c900) 00010000:00010000:0.0:1789120963.192942:0:16250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120963.192946:0:16250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120963.193198:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+27:14709:x1876028901418752:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 2252us (3552us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789120963.193208:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 43 00000100:00100000:3.0:1789120963.197894:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.202744:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419008 00000100:00100000:1.0:1789120963.202758:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419008 00000100:00100000:1.0:1789120963.202823:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:1.0:1789120963.202833:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+27:14709:x1876028901419008:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120963.202886:0:14835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120963.202911:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b291 expref: 27 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.202929:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd9fd7c900) 00010000:00010000:1.0:1789120963.202941:0:14835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120963.202964:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.202976:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.202985:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203772:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203803:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203813:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203883:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203890:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203896:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203901:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120963.203906:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203912:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203922:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ffd82ac2e00) 00010000:00010000:1.0:1789120963.203925:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120963.203929:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203935:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203947:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203959:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203965:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203971:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120963.203974:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203981:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.203988:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x71b3fdea (ffff9ffda3a2ac00) 00010000:00010000:1.0:1789120963.203991:0:14835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120963.203994:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.205499:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bba00/0x13cfa3d77faa63c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71b3fdea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.205792:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+26:14709:x1876028901419008:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 2956us (7903us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120963.205802:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 44 00000100:00100000:3.0:1789120963.222586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.222821:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419136 00000100:00100000:2.0:1789120963.222831:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419136 00000100:00100000:2.0:1789120963.222881:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:2.0:1789120963.222890:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+26:14709:x1876028901419136:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120963.222908:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120963.222928:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b298 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.222965:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa63d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.222995:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa63d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.223007:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa63d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.223097:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b298 expref: 28 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.223127:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57200/0x13cfa3d77faa63d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b298 expref: 27 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.223135:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:2.0:1789120963.223138:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120963.223181:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57200, rc 0) 00000100:00100000:2.0:1789120963.223247:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+27:14709:x1876028901419136:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 357us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.223255:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 45 00000100:00100000:3.0:1789120963.228016:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.228247:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419392 00000100:00100000:2.0:1789120963.228256:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419392 00000100:00100000:2.0:1789120963.228381:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 46 00000100:00100000:2.0:1789120963.228392:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+27:14709:x1876028901419392:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120963.228466:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.228482:0:14837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.228512:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120963.229787:0:14837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789120963.229800:0:14837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430483655583ns, next at 431483653351ns, rc = 0 00000004:00010000:2.0:1789120963.229883:0:14837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000221b32f5 reply state 000000007f1e2f8a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.229894:0:14837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120963.229995:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb54de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+29:14709:x1876028901419392:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 1602us (1985us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789120963.230004:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 46 00010000:00010000:2.0:1789120963.232127:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232171:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232181:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232188:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1789120963.232192:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232201:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232215:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:2.0:1789120963.232219:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789120963.232250:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.232257:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57e00/0x13cfa3d77faa63dc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120963.234535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.234600:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419520 00000100:00100000:2.0:1789120963.234608:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419520 00000100:00100000:2.0:1789120963.234667:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:2.0:1789120963.234677:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+28:14709:x1876028901419520:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120963.234699:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120963.234716:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b29f expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.234770:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 29 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.234784:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 29 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.234801:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:2.0:1789120963.234804:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120963.234807:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0b57600, rc 0) 00000100:00100000:2.0:1789120963.234863:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc83460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+29:14709:x1876028901419520:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 187us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.234871:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 47 00000100:00100000:3.0:1789120963.237781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.237860:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419648 00000100:00100000:2.0:1789120963.237869:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419648 00000100:00100000:2.0:1789120963.237930:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00100000:2.0:1789120963.237953:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2350:x1876028901419648:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789120963.238459:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2350:x1876028901419648:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 506us (683us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789120963.238467:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 12 00000100:00080000:3.0:1789120963.238936:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120963.240618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.240796:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901419904 00000100:00100000:1.0:1789120963.240804:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901419904 00000100:00100000:1.0:1789120963.240857:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:1.0:1789120963.240866:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+29:14709:x1876028901419904:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789120963.241074:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+30:14709:x1876028901419904:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 208us (461us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789120963.241095:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 9 00000100:00100000:2.0:1789120963.243914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.243991:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420160 00000100:00100000:1.0:1789120963.244000:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420160 00000100:00100000:1.0:1789120963.244052:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:1.0:1789120963.244062:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+30:14709:x1876028901420160:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120963.244200:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+30:14709:x1876028901420160:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 139us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.244208:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 48 00000100:00100000:2.0:1789120963.247387:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.247583:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420288 00000100:00100000:0.0:1789120963.247592:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420288 00000100:00100000:0.0:1789120963.247649:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789120963.247659:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+30:14709:x1876028901420288:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120963.247689:0:14836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120963.247710:0:14836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa63ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b2a6 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247795:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247809:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247827:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120963.247864:0:14836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789120963.247882:0:14836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247908:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4ae00/0x13cfa3d77faa63ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2a6 expref: 32 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247925:0:14836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2a6 expref: 31 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.247933:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:0.0:1789120963.247936:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789120963.247940:0:14836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4aa00, rc 0) 00000100:00100000:0.0:1789120963.247999:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+31:14709:x1876028901420288:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 342us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120963.248006:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 49 00000100:00100000:0.0:1789120963.253529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.253677:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420416 00000100:00100000:1.0:1789120963.253686:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420416 00000100:00100000:1.0:1789120963.253740:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:1.0:1789120963.253748:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+6:2349:x1876028901420416:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120963.253765:0:15516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120963.253786:0:15516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b2ad expref: -99 pid: 15516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120963.253810:0:15516:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d1c2, blocks: 0x1 00010000:00010000:1.0:1789120963.253827:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789120963.253832:0:15516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.253840:0:15516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 7 pid: 15516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.253858:0:15516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 7 pid: 15516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.253888:0:15516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffdb99bba00, rc 0) 00000100:00100000:1.0:1789120963.253946:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2349:x1876028901420416:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 199us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.253953:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:2.0:1789120963.257624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.257771:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420672 00000100:00100000:1.0:1789120963.257781:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420672 00000100:00100000:1.0:1789120963.257836:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:1.0:1789120963.257845:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+31:14709:x1876028901420672:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120963.257989:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+31:14709:x1876028901420672:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 144us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.258007:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 50 00000100:00100000:2.0:1789120963.262867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.262925:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420800 00000100:00100000:0.0:1789120963.262934:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420800 00000100:00100000:1.0:1789120963.263085:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:1.0:1789120963.263097:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+31:14709:x1876028901420800:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789120963.303949:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1789120963.303969:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1789120963.303975:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789120963.303986:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789120963.304016:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1789120963.304035:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789120963.304235:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120963.304263:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922375040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789120963.304335:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120963.304404:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922375040 00000100:00100000:2.0:1789120963.304410:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922375040 00000100:00100000:2.0:1789120963.304464:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120963.304473:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922375040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789120963.304618:0:15518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789120963.304621:0:15518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789120963.304623:0:15518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789120963.304625:0:15518:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789120962 -> 1789120962 00002000:00010000:2.0:1789120963.304628:0:15518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789120963.304680:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1876028922375040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (344us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789120963.304688:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789120963.304710:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789120963.304738:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ffdb5dda580/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789120963.304744:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb5dda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922375040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789120963.305211:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14709:x1876028901420800:12345-192.168.206.9@tcp:44:lhsmtool_posix.0 Request processed in 42114us (42351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120963.305231:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 51 00000100:00100000:2.0:1789120963.308603:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.308794:0:15516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901420928 00000100:00100000:1.0:1789120963.308804:0:15516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901420928 00000100:00100000:1.0:1789120963.308858:0:15516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789120963.308867:0:15516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2350:x1876028901420928:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789120963.309010:0:15516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2350:x1876028901420928:12345-192.168.206.9@tcp:16:lhsmtool_posix.0 Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.309019:0:15516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:2.0:1789120963.311343:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.311494:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421184 00000100:00100000:1.0:1789120963.311502:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421184 00000100:00100000:1.0:1789120963.311554:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 52 00000100:00100000:1.0:1789120963.311578:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14709:x1876028901421184:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120963.311639:0:14835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120963.311674:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa63f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2a6 expref: 14 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.311691:0:14835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:1.0:1789120963.311696:0:14835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120963.311723:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.311740:0:14835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.311749:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120963.311930:0:14835:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001aef1548 reply state 00000000a4bb852b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.311939:0:14835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120963.312027:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5ddad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+15:14709:x1876028901421184:12345-192.168.206.9@tcp:36:lhsmtool_posix.0 Request processed in 450us (691us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789120963.312034:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 52 00010000:00010000:0.0:1789120963.313873:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313901:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313912:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313919:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1789120963.313924:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313931:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313946:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:0.0:1789120963.313949:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120963.313953:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.313960:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bb000/0x13cfa3d77faa63ff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.315423:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.315898:0:15518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421312 00000100:00100000:0.0:1789120963.315906:0:15518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421312 00000100:00100000:0.0:1789120963.315969:0:15518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 16 00000100:00100000:0.0:1789120963.315978:0:15518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:14709:x1876028901421312:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120963.315995:0:15518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120963.316174:0:15518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf69c54868ba8b2b4 expref: -99 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.316222:0:15518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 8 pid: 15516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.316231:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120963.316235:0:15518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120963.316240:0:15518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.316271:0:15518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 8 pid: 15516 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.316285:0:15518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 8 pid: 15516 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.316377:0:15518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15518:1876028922375168:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120963.316627:0:15518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120963.320077:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120963.320171:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421440 00000100:00100000:3.0:1789120963.320179:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421440 00010000:00010000:3.0:1789120963.320218:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 9 pid: 15516 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120963.320261:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:3.0:1789120963.320271:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:2350:x1876028901421440:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120963.320284:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789120963.320395:0:15518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15518:1876028922375168:192.168.206.9@tcp:104: 00010000:00010000:3.0:1789120963.320411:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 9 pid: 15516 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.320418:0:15518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 9 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.320423:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 9 pid: 15516 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.320693:0:15518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ffda0d4ae00, rc 0) 00000100:00100000:0.0:1789120963.320749:0:15518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5dd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:14709:x1876028901421312:12345-192.168.206.9@tcp:101:lhsmtool_posix.0 Request processed in 4771us (5332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120963.320767:0:15518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 16 00010000:00010000:3.0:1789120963.321213:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c475697c/0x13cfa3d77faa63f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2ad expref: 8 pid: 15516 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.321228:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.321232:0:14821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.321239:0:14821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.321249:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.321284:0:14821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 7 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120963.321526:0:14821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14821:1876028922375296:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789120963.321645:0:14821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120963.324692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120963.324714:0:14821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14821:1876028922375296:192.168.206.9@tcp:105: 00010000:00010000:3.0:1789120963.324736:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120963.324780:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421568 00000100:00100000:0.0:1789120963.324787:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421568 00000100:00100000:3.0:1789120963.324792:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb98ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+8:2350:x1876028901421440:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 4523us (4723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120963.324800:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 13 00000100:00100000:0.0:1789120963.324834:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:0.0:1789120963.324842:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2350:x1876028901421568:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789120963.325543:0:15517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789120963.325548:0:15517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789120962 00002000:00010000:0.0:1789120963.325551:0:15517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789120961 00002000:00010000:0.0:1789120963.325553:0:15517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789120962 -> 1789120962 00002000:00010000:0.0:1789120963.325556:0:15517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789120963.325601:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd90642d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+8:2350:x1876028901421568:12345-192.168.206.9@tcp:2:lhsmtool_posix.0 Request processed in 754us (915us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789120963.325610:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 17 00000100:00100000:2.0:1789120963.328355:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.328554:0:16875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421696 00000100:00100000:1.0:1789120963.328562:0:16875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421696 00000100:00100000:1.0:1789120963.328654:0:16875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:1.0:1789120963.328663:0:16875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+8:2349:x1876028901421696:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789120963.328702:0:16875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.328730:0:16875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.328738:0:16875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.328742:0:16875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120963.328747:0:16875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.328780:0:16875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 8 pid: 15518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.328794:0:16875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 8 pid: 15518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.328810:0:16875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16875:1876028922375424:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120963.328889:0:16875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffda3fd6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120963.331349:0:16875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdb598d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16875:1876028922375424:192.168.206.9@tcp:104: 00010000:00010000:1.0:1789120963.331378:0:16875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.334043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.334216:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901421824 00000100:00100000:0.0:1789120963.334339:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901421824 00010000:00010000:2.0:1789120963.334519:0:14822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 9 pid: 15518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.334597:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 14 00000100:00100000:2.0:1789120963.334608:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:2349:x1876028901421824:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120963.334622:0:14822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120963.334643:0:14822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 9 pid: 15518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.334657:0:14822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 9 pid: 15518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.334689:0:14822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4efc2f6/0x13cfa3d77faa6406 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b2b4 expref: 9 pid: 15518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.334705:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120963.334709:0:14822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120963.334715:0:14822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.334744:0:14822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.334778:0:14822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120963.334831:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8188027b-f5f1-41c7-85a7-84ef28178cbf+8:2349:x1876028901421824:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 224us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.334839:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 14 00010000:00010000:1.0:1789120963.334899:0:16875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334909:0:16875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334951:0:16875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334959:0:16875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334967:0:16875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334974:0:16875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120963.334978:0:16875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.334987:0:16875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.335000:0:16875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.335008:0:16875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa640d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.335052:0:16875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2349:x1876028901421696:12345-192.168.206.9@tcp:1:lhsmtool_posix.0 Request processed in 6390us (6705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.335070:0:16875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 18 00000100:00100000:2.0:1789120963.338007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.338078:0:14836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422080 00000100:00100000:0.0:1789120963.338087:0:14836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422080 00000100:00100000:0.0:1789120963.338226:0:14836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 53 00000100:00100000:0.0:1789120963.338236:0:14836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdafe9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+14:14709:x1876028901422080:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789120963.338485:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338504:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338515:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338781:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338793:0:14836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 15 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338801:0:14836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338835:0:14836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 15 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.338847:0:14836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 15 pid: 14836 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.338860:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14836:1876028922375552:192.168.206.9@tcp:104: 00000100:00100000:0.0:1789120963.338992:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120963.342434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.342608:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422208 00000100:00100000:1.0:1789120963.342616:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422208 00010000:00010000:1.0:1789120963.342656:0:14821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 16 pid: 14836 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.342724:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14836:1876028922375552:192.168.206.9@tcp:104: 00000100:00100000:1.0:1789120963.342732:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 15 00000100:00100000:1.0:1789120963.342740:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+16:2350:x1876028901422208:12345-192.168.206.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120963.342746:0:14836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342753:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120963.342760:0:14821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 16 pid: 14836 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342772:0:14821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 16 pid: 14836 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342798:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57600/0x13cfa3d77faa63e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b29f expref: 16 pid: 14836 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342813:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:1.0:1789120963.342817:0:14821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342826:0:14821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342833:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.342879:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120963.342913:0:14836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.342920:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.343023:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+15:2350:x1876028901422208:12345-192.168.206.9@tcp:103:ldlm_bl.0 Request processed in 283us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.343031:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 15 00000001:00080000:0.0:1789120963.343207:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789120963.343409:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789120963.343454:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789120963.343603:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14836:1876028922375680:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789120963.343692:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120963.343724:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffc8348c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120963.343782:0:14840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922375680 00000100:00100000:2.0:1789120963.343788:0:14840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922375680 00000100:00100000:2.0:1789120963.343850:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120963.343858:0:14840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14836:x1876028922375680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789120963.343951:0:14840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14836:x1876028922375680:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120963.343958:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120963.344135:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdc1e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14836:1876028922375680:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789120963.345207:0:14836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789120963.345472:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14836:1876028922375808:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789120963.345520:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120963.345577:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120963.345705:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922375808 00000100:00100000:0.0:1789120963.345711:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922375808 00000100:00100000:0.0:1789120963.345754:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120963.345763:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14836:x1876028922375808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789120963.345982:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14836:x1876028922375808:12345-0@lo:1000:mdt00_001.0 Request processed in 218us (461us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789120963.345990:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120963.346017:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14836:1876028922375808:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789120963.346046:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346056:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346064:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346070:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81690400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120963.346075:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346081:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346096:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:3.0:1789120963.346099:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120963.346103:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346108:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffd81690400/0x13cfa3d77faa641b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346217:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346232:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346310:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346317:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1789120963.346320:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346327:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346337:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:3.0:1789120963.346339:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120963.346346:0:14836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 18 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346356:0:14836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 18 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346364:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 18 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.346389:0:14836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b56200/0x13cfa3d77faa637a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.9@tcp remote: 0xf69c54868ba8b283 expref: 18 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120963.346401:0:14836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14836:1876028922375936:192.168.206.9@tcp:105: 00000100:00100000:3.0:1789120963.346577:0:14836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ffd8fbfd480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120963.349319:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.349348:0:14836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd832b8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14836:1876028922375936:192.168.206.9@tcp:105: 00000100:00100000:1.0:1789120963.349410:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422336 00000100:00100000:1.0:1789120963.349416:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422336 00000100:00100000:1.0:1789120963.349464:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 10 00000100:00100000:1.0:1789120963.349473:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffc8182ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14707:x1876028901422336:12345-192.168.206.9@tcp:49:dd.0 00000100:00100000:1.0:1789120963.349583:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffc8182ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:14707:x1876028901422336:12345-192.168.206.9@tcp:49:dd.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120963.349591:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 10 00010000:00010000:0.0:1789120963.350478:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.350493:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0b57a00/0x13cfa3d77faa6373 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350750:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350764:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350776:0:14836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350785:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350791:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350797:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350820:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120963.350825:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350832:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350843:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:1.0:1789120963.350846:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120963.350850:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350856:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99ba200/0x13cfa3d77faa6422 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350865:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350870:0:14836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350875:0:14836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350880:0:14836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0d4aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1789120963.350883:0:14836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350888:0:14836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350906:0:14836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ffd82ac2600) 00010000:00010000:1.0:1789120963.350908:0:14836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120963.350911:0:14836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.350916:0:14836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffda0d4aa00/0x13cfa3d77faa6414 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.351130:0:14836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdafe9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+18:14709:x1876028901422080:12345-192.168.206.9@tcp:57:lhsmtool_posix.0 Request processed in 12893us (13189us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789120963.351139:0:14836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 53 00000020:00080000:1.0:1789120963.351165:0:14836:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789120963.351578:0:14869:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789120963.351583:0:14869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120963.351611:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789120963.351618:0:14869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789120963.354390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.354556:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422592 00000100:00100000:1.0:1789120963.354565:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422592 00000100:00100000:1.0:1789120963.354615:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 11 00000100:00100000:1.0:1789120963.354625:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+18:14709:x1876028901422592:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789120963.355610:0:14839:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789120963.355838:0:14839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789120963.355880:0:14839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355894:0:14839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355904:0:14839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355911:0:14839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355928:0:14839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355933:0:14839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.355995:0:14839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789120963.356088:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8188027b-f5f1-41c7-85a7-84ef28178cbf+20:14709:x1876028901422592:12345-192.168.206.9@tcp:35:lhsmtool_posix.0 Request processed in 1462us (1703us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789120963.356096:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 11 00000020:00080000:1.0:1789120963.356100:0:14839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789120963.357889:0:14824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120963.357899:0:14824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.357909:0:14824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bbc00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120963.357913:0:14824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.357922:0:14824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.357954:0:14824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ffd831cf700) 00010000:00010000:0.0:1789120963.357957:0:14824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789120963.357962:0:14824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.357968:0:14824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ffdb99bbc00/0x13cfa3d77faa6429 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.358057:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120963.358060:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120963.358061:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120963.513809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.517306:0:15522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422720 00000100:00100000:1.0:1789120963.517320:0:15522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422720 00000100:00100000:1.0:1789120963.517508:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789120963.517519:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+7:2350:x1876028901422720:12345-192.168.206.9@tcp:4:dd.0 00002000:00010000:1.0:1789120963.517567:0:15522:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3d1c2, atime: 0x6aa3d1c1, ctime: 0x6aa3d1c2, blocks: 0x1 00010000:00010000:1.0:1789120963.517576:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.517591:0:15522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1789120963.517596:0:15522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.517603:0:15522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.517618:0:15522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120963.517805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.517907:0:15524:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789120963.517917:0:15524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789120963.518784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.518827:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789120963.518840:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422848 00000100:00100000:0.0:1789120963.518846:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422848 00000100:00100000:0.0:1789120963.518877:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789120963.518881:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901422976 00000100:00100000:0.0:1789120963.518884:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901422976 00000100:00100000:3.0:1789120963.520119:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:3.0:1789120963.520134:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:2349:x1876028901422848:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:3.0:1789120963.520182:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.520197:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.520201:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.520206:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.520219:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.524546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.526173:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:0.0:1789120963.530419:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789120963.530588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:2.0:1789120963.530627:0:15524:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789120963.537604:0:15523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789120963.537753:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901423104 00000100:00100000:0.0:1789120963.537763:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901423104 00000100:00100000:0.0:1789120963.537816:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789120963.537824:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901423232 00000100:00100000:0.0:1789120963.537827:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901423232 00000100:00100000:0.0:1789120963.539497:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 2 00000100:00100000:0.0:1789120963.539513:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8188027b-f5f1-41c7-85a7-84ef28178cbf+13:2349:x1876028901422976:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:0.0:1789120963.539550:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.539567:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120963.539572:0:17068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120963.539579:0:17068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.539601:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.541888:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:1.0:1789120963.541934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.9@tcp (source: 12345-192.168.206.9@tcp) 00000100:00100000:3.0:1789120963.542015:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789120963.542024:0:15523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1789120963.546909:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901423360 00000100:00100000:3.0:1789120963.546922:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901423360 00000100:00100000:3.0:1789120963.546979:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789120963.546987:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901423488 00000100:00100000:3.0:1789120963.546990:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901423488 00000100:00100000:3.0:1789120963.547003:0:15523:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789120963.547007:0:15523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028901423616 00000100:00100000:3.0:1789120963.547009:0:15523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028901423616 00000100:00100000:3.0:1789120963.548684:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 3 00000100:00100000:3.0:1789120963.548713:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8188027b-f5f1-41c7-85a7-84ef28178cbf+17:2349:x1876028901423104:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:3.0:1789120963.548758:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.548775:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.548779:0:17069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120963.548786:0:17069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120963.548799:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.549087:0:15524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:2.0:1789120963.558052:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789120963.558069:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8188027b-f5f1-41c7-85a7-84ef28178cbf+20:2349:x1876028901423232:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789120963.558125:0:17070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.558165:0:17070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120963.558170:0:17070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120963.558178:0:17070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.558191:0:17070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120963.595087:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1789120963.595102:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1789120963.595117:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1789120963.595345:0:15522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789120963.595350:0:15522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789120962 -> 1789120963 00002000:00010000:1.0:1789120963.595353:0:15522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789120962 -> 1789120963 00002000:00010000:1.0:1789120963.595355:0:15522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789120963.595369:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595383:0:15522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595392:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595400:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120963.595404:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595414:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595433:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.595454:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa6430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.595534:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+18:2350:x1876028901422720:12345-192.168.206.9@tcp:4:dd.0 Request processed in 78014us (81730us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789120963.595544:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 0 00000100:00100000:1.0:1789120963.595881:0:15522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 5 00000100:00100000:1.0:1789120963.595894:0:15522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+17:2349:x1876028901423360:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:1.0:1789120963.595998:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.596010:0:15522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.596014:0:15522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.596020:0:15522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.596031:0:15522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120963.657201:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789120963.663065:0:17067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 6291456 00002000:00010000:1.0:1789120963.663074:0:17067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:1.0:1789120963.663088:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663102:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663131:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663138:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120963.663157:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663168:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663187:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663194:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004326a0f1/0x13cfa3d77faa6437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.663751:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:2349:x1876028901422848:12345-192.168.206.9@tcp:4:dd.0 Request processed in 143615us (145941us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789120963.663762:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 1 00000100:00100000:1.0:1789120963.663795:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 6 00000100:00100000:1.0:1789120963.663806:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb598f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+22:2349:x1876028901423488:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:1.0:1789120963.663840:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663853:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.663864:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120963.663870:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.663882:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120963.719618:0:17069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789120963.719627:0:17069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1789120963.719642:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.719655:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.719934:0:17070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.719943:0:17070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.719950:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.719958:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57a00 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:2.0:1789120963.719962:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.719973:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.720007:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.720014:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2e634f/0x13cfa3d77faa644c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120963.720094:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8188027b-f5f1-41c7-85a7-84ef28178cbf+24:2349:x1876028901423232:12345-192.168.206.9@tcp:4:dd.0 Request processed in 162026us (193950us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789120963.720104:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 4 00000100:00100000:2.0:1789120963.720175:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.9@tcp, seq: 7 00000100:00100000:2.0:1789120963.720188:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:2349:x1876028901423616:12345-192.168.206.9@tcp:4:dd.0 00010000:00010000:2.0:1789120963.720220:0:17070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.720231:0:17070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120963.720236:0:17070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120963.720241:0:17070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120963.720253:0:17070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720675:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720686:0:15522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720705:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720713:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99bb200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120963.720717:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720724:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720734:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.720741:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18b68fe/0x13cfa3d77faa6453 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 7 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.720799:0:15522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8188027b-f5f1-41c7-85a7-84ef28178cbf+23:2349:x1876028901423360:12345-192.168.206.9@tcp:4:dd.0 Request processed in 124909us (190216us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789120963.720806:0:15522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 5 00010000:00010000:1.0:1789120963.721025:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721034:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721041:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721048:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd81691000 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:1.0:1789120963.721051:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721058:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721070:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120963.721077:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004783224e/0x13cfa3d77faa643e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120963.721131:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8188027b-f5f1-41c7-85a7-84ef28178cbf+21:2349:x1876028901422976:12345-192.168.206.9@tcp:4:dd.0 Request processed in 181623us (202349us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789120963.721139:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 2 00010000:00010000:0.0:1789120963.721228:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.721237:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffd8149a800 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120963.721241:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.721248:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.721258:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.721265:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1107b5c/0x13cfa3d77faa6445 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.721374:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8188027b-f5f1-41c7-85a7-84ef28178cbf+19:2349:x1876028901423104:12345-192.168.206.9@tcp:4:dd.0 Request processed in 172669us (196836us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789120963.721381:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 3 00000001:00080000:0.0:1789120963.721405:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:1.0:1789120963.763874:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1789120963.764249:0:17067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1789120963.764255:0:17067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789120963.764268:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764280:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764288:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764296:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffdb99ba200 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120963.764301:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764310:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764336:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.764359:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3e3f5e/0x13cfa3d77faa645a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.764580:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb598f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8188027b-f5f1-41c7-85a7-84ef28178cbf+9:2349:x1876028901423488:12345-192.168.206.9@tcp:4:dd.0 Request processed in 100774us (222696us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789120963.764589:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 6 00000001:00080000:1.0:1789120963.801758:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1789120963.802077:0:17070:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789120963.802092:0:17070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802104:0:17070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802123:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802130:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ffda0b57600 already unused, calling callback (ffffffffc14bc550) 00010000:00010000:0.0:1789120963.802134:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802170:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802190:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120963.802213:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c57ad1/0x13cfa3d77faa6461 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120963.802470:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdb5fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8188027b-f5f1-41c7-85a7-84ef28178cbf+5:2349:x1876028901423616:12345-192.168.206.9@tcp:4:dd.0 Request processed in 82282us (260530us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789120963.802480:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.9@tcp, seq: 7 00010000:00010000:2.0:1789120963.818376:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120964.330484:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120964.330506:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922376064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120964.330572:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120964.330916:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376064 00000100:00100000:1.0:1789120964.330924:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376064 00000100:00100000:1.0:1789120964.330998:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120964.331017:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922376064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120964.331057:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789120964.331120:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876028922376064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120964.331128:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120964.331191:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffdafe9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876028922376064:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789120964.331362:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789120964.842544:0:14824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120965.146384:0:17108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789120965.866465:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922376576:0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.866493:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922376320:0@lo:400:kworker.0 00010000:00010000:2.0:1789120965.866640:0:14823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120965.867109:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922376192:0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.867905:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.867985:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.868028:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922376448:0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.868063:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.868107:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376576 00000100:00100000:3.0:1789120965.868116:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376576 00000100:00100000:3.0:1789120965.868197:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789120965.868209:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922376576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.868276:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876028922376576:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120965.868284:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922376832:0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.868287:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120965.868320:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.868322:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376320 00000100:00100000:3.0:1789120965.868327:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376320 00000100:00100000:1.0:1789120965.868365:0:16250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376832 00000100:00100000:1.0:1789120965.868371:0:16250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376832 00000100:00100000:3.0:1789120965.868384:0:15517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376448 00000100:00100000:3.0:1789120965.868389:0:15517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376448 00000100:00100000:1.0:1789120965.868421:0:16250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789120965.868425:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789120965.868432:0:16250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922376832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.868437:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922376320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.868489:0:16250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876028922376832:12345-0@lo:400:kworker.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120965.868491:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922376320:12345-0@lo:400:kworker.0 Request processed in 58us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120965.868504:0:16250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789120965.868505:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120965.868517:0:15517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120965.868525:0:15517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922376448:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789120965.868539:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120965.868546:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120965.868558:0:15517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd832bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876028922376448:12345-0@lo:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120965.868656:0:15517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120965.868704:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876028922376576:0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.868736:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789120965.868741:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ffdb5dda580, transno 8589934595 00000004:00080000:3.0:1789120965.868753:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789120965.868896:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876028922376448:0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.868981:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922376320:0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.869068:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876028922376832:0@lo:400:kworker.0 00000100:00100000:1.0:1789120965.869207:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120965.869217:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922376960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120965.869255:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120965.869287:0:15520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376960 00000100:00100000:1.0:1789120965.869291:0:15520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376960 00000100:00100000:1.0:1789120965.869327:0:15520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120965.869336:0:15520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffd91e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922376960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120965.869373:0:15520:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789120965.869419:0:15520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffd91e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876028922376960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120965.869426:0:15520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120965.869459:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876028922376960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120965.870219:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120965.870304:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922376704:0@lo:400:kworker.0 00000100:00100000:0.0:1789120965.870342:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.871181:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376704 00000100:00100000:3.0:1789120965.871193:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376704 00000100:00100000:3.0:1789120965.871428:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789120965.871440:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922376704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120965.871537:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffdc1e6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876028922376704:12345-0@lo:400:kworker.0 Request processed in 100us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120965.871546:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789120965.871914:0:14831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120965.871955:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876028922376704:0@lo:400:kworker.0 00000100:00100000:2.0:1789120965.875083:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028922376192 00000100:00100000:2.0:1789120965.875113:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028922376192 00000100:00100000:2.0:1789120965.875458:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789120965.875472:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ffda0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922376192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120965.875661:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ffda0b64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:663c5952-eef7-4d23-9f6d-c418f8c48dc5+19:3318:x1876028922376192:12345-0@lo:400:kworker.0 Request processed in 192us (5445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120965.875670:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789120965.878938:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ffd91e6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:663c5952-eef7-4d23-9f6d-c418f8c48dc5:3318:1876028922376192:0@lo:400:kworker.0 Debug log: 29883 lines, 29883 kept, 0 dropped, 0 bad.